P0L0's Blog » svn

Installing TRAC with mod_wsgi using virtualenv

P0L0 — Mon, 10 May 2010 19:33:03 +0000

This guide is for installing Trac as a user using virtualenv for a isolated Python environment so that the whole installation runs under a specific user.

First of all we need to install needed packages

apt-get install libapache2-mod-wsgi python-virtualenv python-setuptools

Once we have installed the required packages proceed to create the Python environment

mkdir /usr/local/trac
cd /usr/local/trac
virtualenv python

We now have the isolated Python environment locate under /usr/local/trac/python.

To make possible to use easy_install with repositories we need to upgrade easy_install. I use this to install Trac plugins directly from SVN.

/usr/local/trac/python/bin/easy_install -U trunk

We now can install trac 0.12 using the 0.12b1 SVN Tag (http://svn.edgewall.com/repos/trac/tags/trac-0.12b1 or Trac==0.12b1) or directly from SVN Trunk:

/usr/local/trac/python/bin/easy_install http://svn.edgewall.org/repos/trac/trunk

This will download and install the latest trunk version for Trac.

To have webaccess to the Trac projects, we need a .wsgi script, were we define where our local python environment is located:

# Not needed if mod_wsgi >= 3.0
import sys
sys.stdout = sys.stderr
 
# Load Trac
import trac.web.main
application = trac.web.main.dispatch_request

And finally we need to configure apache. If you want only one Trac project, you should define trac.env to the location of your trac, but if you want multiproject support, you must use trac.env_parent_dir (this is what I used)

<virtualhost *:80>
    ServerName trac.dns.com
 
    DocumentRoot /usr/local/trac/htdocs
    ErrorLog /var/log/apache2/trac-error.log
    CustomLog /var/log/apache2/trac-access.log combined
 
    # Trac Auth
    <location />
        AuthType Basic
        AuthName "Trac"
        AuthUserFile /usr/local/trac/.htpasswd
        Require valid-user
    < /location>
 
    #Trac
    #Define ProcessGroup with user and group under which it should run
    WSGIDaemonProcess trac user=trac group=trac python-path=/usr/local/trac/python/lib/python2.5/site-packages python-eggs=/usr/local/trac/python/cache
    WSGIScriptAlias / /usr/local/trac/htdocs/trac.wsgi
 
    <directory /usr/local/trac/htdocs>
        WSGIProcessGroup trac
        WSGIApplicationGroup %{GLOBAL}
        SetEnv trac.env_parent_dir /usr/local/trac/projects
    directory>
virtualhost>

We need to create the user and change the permissions for /usr/local/trac for that user trac

adduser --home /usr/local/trac --shell /bin/false --no-create-home trac
chown -R trac:trac /usr/local/trac

If you get an error "ImportError: No module named simplejson" just install it using easy_install

/usr/local/trac/python/bin/easy_install simplejson

Netbeans Performance Switches

P0L0 — Sat, 17 Apr 2010 07:30:23 +0000

I recently have began to use Netbeans because I'm sad that Eclipse is every time slower and it frozes every time when you are doing something to fast.

Netbeans is not perfect, and there are some features that need to be polished (Ex.: SVN Support, Time Tracking like Mylyn), but the PHP/HTML/CSS/JS Support is excellent, in my opinion better than the Eclipse PDF support.

These is my netbeans_default_options for Netbeans for MacOSX (under Windows you can leave out the --laf switch, it's for changing the look and feel):

netbeans_default_options="-J-client -J-Xss2m -J-Xms32m -J-Xmx512m -J-XX:PermSize=32m -J-XX:MaxPermSize=200m -J-Xverify:none -J-XX:CompileThreshold=100 -XX:+CompressedOOPS -XX:+AggressiveOpts -XX:+TieredCompilation -XX:+DoEscapeAnalysis -XX:+UseConcMarkSweepGC -J-XX:+CMSClassUnloadingEnabled -J-XX:+CMSPermGenSweepingEnabled -J-Dapple.laf.useScreenMenuBar=true -J-Dsun.java2d.noddraw=true --laf javax.swing.plaf.metal.MetalLookAndFeel"

Some switches come from Netbeans Performance site.

-J-Xss2m - Define Stack Size (Too small and you will get StackOverflow Exceptions)
-J-Xms32m - This setting tells the Java virtual machine to set its initial heap size to 32 megabytes. By telling the JVM how much memory it should initially allocate for the heap, we save it growing the heap as NetBeans consumes more memory. This switch improves startup time
-J-Xmx512m - This settings tells the Java virtual machine the maximum amount of memory it should use for the heap. Placing a hard upper limit on this number means that the Java process cannot consume more memory than physical RAM available. This limit can be raised on systems with more memory. Current default value is 128MB. Note: Do not set this value to near or greater than the amount of physical RAM in your system or it will cause severe swapping during runtime
-J-XX:PermSize=32m -J-XX:MaxPermSize=200m - How much Heap can be added over the Xmx limit
-J-Xverify:none - This switch turns off Java bytecode verification, making classloading faster, and eliminating the need for classes to be loaded during startup solely for the purposes of verification. This switch improves startup time, and there is no reason not to use it
-J-XX:CompileThreshold=100 - This switch will make startup time slower, by HotSpot to compile many more methods down to native code sooner than it otherwise would. The reported result is snappier performance once the IDE is running, since more of the UI code will be compiled rather than interpreted. This value represents the number of times a method must be called before it will be compiled
-XX:+CompressedOOPS - Activate Compressed "Ordinary Object Pointer"
-XX:+AggressiveOpts - Turns on point performance optimizations that are expected to be on by default in upcoming releases
-XX:+TieredCompilation - Activate Tiered Compiler
-XX:+DoEscapeAnalysis - Activate Escape Analysis
-J-XX:+UseConcMarkSweepGC or -J-XX:+UseParNewGC Try these switches if you are having problems with intrusive garbage collection pauses. This switch causes the JVM to use different algorithms for major garbage collection events (also for minor collections, if run on a multiprocessor workstation), ones which do not "stop the world" for the entire garbage collection process. You should also add the line -J-XX:+CMSClassUnloadingEnabled and -J-XX:+CMSPermGenSweepingEnabled to your netbeans.conf file so that class unloading is enabled (it isn't by default when using this collector)

Eclipse Configuration for Web Development

P0L0 — Tue, 28 Jul 2009 19:11:17 +0000

After trying very different IDE and many Eclipse IDE flawors, this is the best configuration I have found, and all the components are free.

First of all we need to download Eclipse Classic from the Eclipse website.

One of the first things we need to do is to change eclipse.ini, we will make it start faster and increase the memory limit

--launcher.XXMaxPermSize
256m
-vm
/usr/bin/java
-vmargs
-Xms40m
-Xmx1024m

The path to Java VM depends on your installation and system, in windows you must search for "javaw.exe". Setting the path to Java VM makes that Eclipse stops searching for the Java VM every start, which makes the start faster.

Now we can start installing the required Plugins. In "Help->Install New Software..." we will add the following Update Sites.

Aptana - http://update15.aptana.org/studio/25914/
Mylyn - http://download.eclipse.org/tools/mylyn/update/e3.4
Mylyn Extras - http://download.eclipse.org/tools/mylyn/update/extras
SVNKit - http://community.polarion.com/projects/subversive/download/eclipse/2.0/galileo-site/
EPIC (Perl) - http://e-p-i-c.sourceforge.net/updates/testing optional, only if you need Perl

You have noticed that at each start a Window Asking for Installing Addiontal Features. Now that we can start installing this features. For me the most important are:

Aptana PHP
Aptana PyDev optional, only if you need Python
Ajax Libraries You can select all or just the one you need

After installing all needed plugins we can start with the configuration.

General\Workspace
- Text file encoding -> UTF-8
- New text file line delimiter -> Unix
General\Editors\Text Editors
- Displayed tab width -> 4
- Insert spaces for tabs -> True
- Show line number -> True
- Show print margin -> True
- Print margin column -> 80
General\Keys
- Show Whitespace Characters (Text Editing) -> Binding: Ctrl+Alt+Space -> When: Editing Text
Aptana\Editors
- Formattings -> Insert selected proposal with 'Tab' key as well as 'Enter' key -> True
- Tab Insertion -> Use spaces (current width is 4)
Aptana\Editors\PHP
- Create project file in new PHP project -> False
Aptana\Editors\PHP\Formatting
- Edit... ->
  - Profile Name -> ZendStandards
  - Control Statemets ->
    - Insert new line before 'else' in an 'if' statement -> False
    - Insert new line before 'catch' in an 'try' statement -> False
    - Insert new line before 'while' in an 'do' statement -> False
    - 'if else' - Keep 'then' statement on same line -> False
  - Braces ->
    - Method declaration -> Next line
    - Blocks -> Same line
    - Blocks in case statement -> Same line
    - 'switch' statement -> Same line
Install/Update\Automatic Updates
- Automatically find new updates and notify me -> True
Team\SVN - SVN Client
- SVN Client -> SVN Kit
- SVN Client -> Use SVN Merge View -> True
Team\SVN\Automatic Properties
- Add: * -> svn:keywords=Id

I use the Aptana Perspective with this views:

Right Top
- Aptana Standard Views\Project
Right Bottom
- General\Outline
- Aptana Standard Views\PHP Elements Views
- Aptana Standard Views\References
Bottom
- General\Tasks
- Aptana Standard Views\Validation
- General\Console
- Team\History
- Team\SVN Properties
- EPIC\RegExp only if you installed EPIC
Left
- Tasks\Task List

I like that the Oultine is automatically expanded, so that I have an overview of the file at every moment, but Aptana does not autoexpand the Outline. I use the following workaround:

Create a new General Project called "_Monkey"
Create a folder called scripts

Create a javascript file called autoExpandOutline.js with the following content

/* 
 * 
 * Menu: EHU > HandlerService (Auto expand outline)
 * Kudos: Ingo Muschenetz & Kevin Lindsey & Steve Daniels
 * License: EPL 1.0
 * Listener: getPartService().addPartListener(this);
 * DOM: http://localhost/com.aptana.ide.scripting
 * DOM: http://download.eclipse.org/technology/dash/update/org.eclipse.eclipsemonkey.lang.javascript
 * 
 * 
*/
 
function getPartService()
{
    var workbench = Packages.org.eclipse.ui.PlatformUI.getWorkbench();
    var result = null;
 
    if (workbench)
    {
        var window = null;
 
        runOnUIThread(function() {
            window = workbench.getActiveWorkbenchWindow();
 
            if (window != null)
            {
                result = window.getPartService();
                //out.println("result set to " + result);
            }
            else
            {
                //out.println("window is not defined");
            }
        });
    }
    else
    {
        //out.println("workbench is not defined");
    }
 
    //out.println("getPartService() is returning " + result);
 
    return result;
}
 
function partBroughtToTop(part)
{
  //out.println("part*()\n");
}  
 
function partClosed(part)
{
  //out.println("part*()\n");
}
 
function partDeactivated(part)
{
  //out.println("part*()\n");
}  
 
function partOpened(part)
{
  //out.println("part*()\n");
}
 
function partActivated(part)
{
  if (part.getEditorInput)
  {
    expandOutline();
  }
}
 
function partVisible(part)
{
  //out.println("part*()\n");
}
 
function partHidden(part)
{
  //out.println("part*()\n");
}
 
function expandOutline()
{
  //out.println("expandOutline()\n");
  try
  {
    //out.println("try\n");
    var editor = editors.activeEditor.textEditor;
 
    editor.getOutlinePage().getTreeViewer().expandAll();
  }
  catch (e)
  {
    //out.println("catch\n");
  }
}

Each new project that you create must use this project as reference, and now every time you open a file the Outline will be expanded automatically when you enter into the Editor

Entorno de desarrollo web con Eclipse

P0L0 — Wed, 18 Oct 2006 17:46:20 +0000

Ultimamente estoy mirando de encontrar el mejor entorno de desarollo multiplataforma que me vaya bien para llevar los proyectos de webs. Finalmente el que me ha convencido ha sido Eclipse con los plugins para PHP/HTML/CSS/Javascript y SVN:

Aptana: HTML/CSS/Javascript. Update Site: http://update.aptana.com/update/
PHPEclipse: PHP. Update Site: http://phpeclipse.sourceforge.net/update/releases/
Subclipse: SVN. Update Site: http://subclipse.tigris.org/update_1.0.x

Lo unico que hace falta para instalarse todos los plugins, es bajarse el ultimo Eclipse e ir a "Help->Software Updates->Find and install..." y añadir los "Update Site" de cada uno bajo "Search for new features to install".

Multiples proyectos con trac y svn usando HTTPS

P0L0 — Tue, 03 Oct 2006 17:51:55 +0000

Voy a explicar como montar el sistema de gestion de proyectos trac y subversion usando https para trabajar con subversion. Yo lo he montado en una debian usando apache2, asi que lo primero que necesitamos es instalar todo lo necesario

apt-get install trac subversion apache2 subversion libapache2-svn libapache2-mod-python2.3

Una vez descargado e instalado creamos el certificado necesario para usar tanto trac y subversion bajo https. Entra en el directorio /etc/apache2/ssl y ejecuta lo siguiente:

openssl genrsa -des3 -out server.key 1024
openssl req -new -key server.key -out server.csr
cp server.key server.key.org
openssl rsa -in server.key.org -out server.key
openssl x509 -req -days 365 -in server.csr -signkey server.key -out server.crt

Ahora ya tenemos listo los certificados, asi que ahora solo nos queda configurar el apache. Yo he creado un trac.dominio.ext y un svn.dominio.ext para hacer esto, pero esto va a gusto de cada uno. Yo como uso dos subdominios distintos, lo tengo en ficheros separados.

Primero editaremos el trac, asi que creamos el fichero /etc/apache2/sites-available/trac.domain.ext

NameVirtualHost *:443
443>
#Activate SSL
SSLEngine on
 
SSLCertificateFile    /etc/apache2/ssl/server.crt
SSLCertificateKeyFile /etc/apache2/ssl/server.key
 
#VirtualHost Servername
ServerName trac.domain.ext
ServerAdmin trac@domain.ext
 
DocumentRoot /opt/projects/trac
 
#Authentication

AuthType Basic
AuthName "Trac"
AuthUserFile /opt/projects/.htpasswd
Require valid-user
 
#Trac
SetHandler mod_python
PythonHandler trac.web.modpython_frontend
PythonOption TracEnvParentDir /opt/projects/trac/
PythonOption TracUriRoot /

El fichero no necesita demasiada explicacion, simplemente le decimos que active el SSL, que pida autentificacion y cargamos el modulo del trac y le especificamos el path de donde estan todos nuestros proyectos.

Ahora vamos con el fichero /etc/apache2/sites-available/svn.domain.ext

NameVirtualHost *:443
443>
#Activate SSL
SSLEngine on
 
SSLCertificateFile    /etc/apache2/ssl/server.crt
SSLCertificateKeyFile /etc/apache2/ssl/server.key
 
#VirtualHost Servername
ServerName svn.domain.ext
ServerAdmin svn@domain.ext
 
DocumentRoot /opt/projects/svn

DAV svn
 
#Authentication
AuthType Basic
AuthName "Subversion"
AuthUserFile /opt/projects/.htpasswd
Require valid-user
 
#Subversion
SVNParentPath /opt/projects/svn
SVNListParentPath on
SVNAutoVersioning On

 
"/.+">
#Subversion permission file
AuthzSVNAccessFile /opt/projects/svn/.htpasswd

Es importante separar el AuthzSVNAccessFile de ya que sino no listara todos los proyectos en http://svn.domain.ext/ por problemas de permisos.

Ahora que tenemos estos ficheros listos, hay que activar el modulo de ssl en el apache2 y los dos dominios.

vi /etc/apache2/ports.conf


Listen 443

cd /etc/apache2/mods-enabled
ln -s /etc/apache2/mods-available/dav.load .
ln -s /etc/apache2/mods-available/dav_svn.load .
ln -s /etc/apache2/mods-available/mod_python.load .
ln -s /etc/apache2/mods-available/ssl.conf .
ln -s /etc/apache2/mods-available/ssl.load .
 
cd /etc/apache2/sites-enabled
ln -s /etc/apache2/sites-available/svn.domain.ext 001-svn.domain.ext
ln -s /etc/apache2/sites-available/trac.domain.ext 001-trac.domain.ext

Ahora vamos a crear un proyecto de prueba

mkdir -p /opt/projects/svn
mkdir -p /opt/projects/trac
svnadmin create /opt/projects/svn/NewProject
trac-admin /opt/projects/trac/NewProject initenv

Project Name [My Project]> NewProject
Database connection string [sqlite:db/trac.db]>
Path to repository [/var/svn/test]> /opt/projects/svn/NewProject
Templates directory [/usr/share/trac/templates]>
Creating and Initializing Project
Configuring Project
trac.repository_dir
trac.database
trac.templates_dir
project.name
Installing default wiki pages
..............

Ahora creamos los ficheros de acceso de usuarios.

[Repositorio:/Path]
user = [ [r[w]]]

Por ejemplo, queremos que el user1 pueda leer y escribir, el user2 leer, y anonymous nada (no deberia haber anonymous ya que el htpasswd no los deja pasar, pero siempre viene bien protegerse por si acaso), el fichero quedaria asi

[NewProject:/]
user1 = rw
user2 = r
* =

Ahora ya tenemos todo listo, podemos instalar el modulo TracWebAdmin para que sea mas facil la administracion del trac.



Share:

SVN Keywords

P0L0 — Wed, 06 Sep 2006 09:28:42 +0000

Siempre habia visto en los ficheros de codigo los tags tipo $Id: default.html 261 2006-09-06 09:06:42Z user $ pero nunca los habia necesitado, pero ahora que estoy con el proyecto de EducacioOberta, para llevar un control de versiones y saber facilmente que fichero pertenece a que revision, he encontrado esto de muy buena utilidad.

Realmente no tiene ningun misterio, tu en tu codigo pones uno de estos Keywords en el formato $Keyword$ y subversion lo sustituira una vez que actives los keywords para este fichero (en phpEclipse con el plugin de SVN, esto se puede hacer facilmente para todos los archivos del proyecto, le das boton derecho al proyecto y eliges "Team->Add Keywords" y activas los que necesites). Los keywords que hay predefinidos son:

LastChangedDate o Date: $LastChangedDate: 2002-07-22 21:42:37 -0700 (Mon, 22 Jul 2002) $
LastChangedRevision, Revision o Rev: $LastChangedRevision: 144 $
LastChangeBy o Author: $LastChangedBy: harry $
HeadURL o URL: $HeadURL: http://svn.collab.net/repos/trunk/README $
Id: $Id: calc.c 148 2002-07-28 21:30:43Z sally $