Building on Ubuntu 12.04 fails

[fschulze]

This ticket now tracks various issues on Ubuntu (#8, #12 and #13).

Since Ubuntu 11.10 it's recommended to use use deadsnake port for old python installation: https://launchpad.net/~fkrull/+archive/deadsnakes

Please don't compile you own Python if you're not able to fix issues in it. Also, Plone does not use Python2.5 only Python 2.4 and Python 2.6. I don't see why it's an issue here.

I think using those packages is better than using this buildout.

[djay]

Using a PPA is not solution for collective.buildout since the point of collective.buildout is to compile your own python.

[fschulze]

At least the reason why I initially created buildout.python was to get all the Python versions I need working on OS X. Not to build my own. The PPA solves that issue on Ubuntu for me. We gladly accept pull request with fixes for Ubuntu, but I won't spend time on doing it myself due to the PPA.

[do3cc]

I followed your advice for using the python ppa. Unfortunately the ubuntu virtualenv has a problem with --no-site-packages. Ubuntu installs packages in dist-packages and my buildout happily adds this directory to my scripts :-(

[miohtama]

I am working with an utility to install, configure, migrate and generally screw up Plone sites on Ubuntu / Debian servers.

I neatly solved this problem by overriding buildout.cfg with a custom version before running boostrap && bin/buildout:

https://github.com/miohtama/senorita.plonetool/blob/d100fba6e2ceabd0c8ed7c223325a29e86f299b4/src/senorita/plonetool/python-buildout.cfg

It simply builds Python versions needed for Plone.

[do3cc]

Nice, but I must correct myself, the no-site-packages problem was somehow related to buildout 2.0, even though I can't reproduce it any longer. Lost a bunch of hair other this one.

[nueces]

I did three different approaches to add support to compile python2.4 with ssl support in debian.
I will like to know what do you think that could be the best of this approaches. I did a few impressions with pros and cons in the commit logs.
I test the patch for ssl in a few ubuntu releases and it work, so I think that based on this work we could add support for old ubuntu releases, with a few or any changes in the osdetect module.

This are the braches:

• https://github.com/nueces/buildout.python/tree/python2.4-debian-codenames
• https://github.com/nueces/buildout.python/tree/python2.4-debian-version
• https://github.com/nueces/buildout.python/tree/python2.4-debian-support

Personally I prefer the first one, because is more explicit and could permit a better maintenance in the future.

[fschulze]

I like the first version, but I don't really understand what is going on with the 'testing' stuff etc. It seems to me like we would have to update that code when new releases come out. For that reason I like the second version better.

But I just saw that we actually have the same issue on the mac. We have to update for each new version explicitly. It would be better if it would work by version number and the newest part specified would be used automatically. Not sure at the moment how that would be best solved.

[fschulze]

I made a slightly modified version of your third variant now. I apply the patch for 'linux2', so for me Ubuntu now works and Debian should as well. Please try current master and confirm.

[nueces]

Sorry, I had no time before to check this issue. I upload the patch again, because the one that was in the repo, contain some minor changes, the tabs replaced by spaces, and for that the patch didn't get correctly applied.

I tested on:

• Debian Sid (Unstable), Jessie (Testing, next 8.x) and Wheezy (Stabe 7.x).
• Ubuntu Lucid (10.04 LTS) and Precise (12.04 LTS)

The patch apply correctly, but in Ubuntu Lucid, I found a new issue not strictly related, but that make the buildout fail.

here the buildout tracebak

python-2.4: Running '
/home/nueces/buildout.python-master/parts/opt/bin/python2.4 /home/nueces/buildout.python-master/src/ez_setup.py
/home/nueces/buildout.python-master/parts/opt/bin/easy_install-2.4 pip==1.1
/home/nueces/buildout.python-master/bin/virtualenv-2.4 --system-site-packages /home/nueces/buildout.python-master/python-2.4
/home/nueces/buildout.python-master/python-2.4/bin/easy_install -U collective.dist'
Downloading https://pypi.python.org/packages/source/s/setuptools/setuptools-1.1.6.tar.gz
Traceback (most recent call last):
  File "/home/nueces/buildout.python-master/src/ez_setup.py", line 370, in ?
    sys.exit(main())
  File "/home/nueces/buildout.python-master/src/ez_setup.py", line 366, in main
    downloader_factory=options.downloader_factory)
  File "/home/nueces/buildout.python-master/src/ez_setup.py", line 278, in download_setuptools
    downloader(url, saveto)
  File "/home/nueces/buildout.python-master/src/ez_setup.py", line 203, in download_file_wget
    subprocess.check_call(cmd)
  File "/home/nueces/buildout.python-master/src/ez_setup.py", line 45, in _check_call_py24
    raise CalledProcessError(msg)
__main__.CalledProcessError: Command '['wget', 'https://pypi.python.org/packages/source/s/setuptools/setuptools-1.1.6.tar.gz', '--quiet', '--output-document', '/home/nueces/buildout.python-master/setuptools-1.1.6.tar.gz']' return non-zero exit status 5
/bin/sh: /home/nueces/buildout.python-master/parts/opt/bin/easy_install-2.4: not found
New python executable in /home/nueces/buildout.python-master/python-2.4/bin/python2.4
Also creating executable in /home/nueces/buildout.python-master/python-2.4/bin/python
Installing distribute.................................................................................................................................................................................................done.
Installing pip................done.
Searching for collective.dist
Reading http://pypi.python.org/simple/collective.dist/
Best match: collective.dist 0.2.5
Downloading https://pypi.python.org/packages/source/c/collective.dist/collective.dist-0.2.5.tar.gz#md5=d892285cbfcb63678e97989664edb197
Processing collective.dist-0.2.5.tar.gz
Writing /tmp/easy_install-Di2QL5/collective.dist-0.2.5/setup.cfg
Running collective.dist-0.2.5/setup.py -q bdist_egg --dist-dir /tmp/easy_install-Di2QL5/collective.dist-0.2.5/egg-dist-tmp-9zWOqv
Adding collective.dist 0.2.5 to easy-install.pth file

Installed /home/nueces/buildout.python-master/python-2.4/lib/python2.4/site-packages/collective.dist-0.2.5-py2.4.egg
Processing dependencies for collective.dist
Searching for docutils
Reading http://pypi.python.org/simple/docutils/
Best match: docutils 0.11
Downloading https://pypi.python.org/packages/source/d/docutils/docutils-0.11.tar.gz#md5=20ac380a18b369824276864d98ec0ad6
Processing docutils-0.11.tar.gz
Writing /tmp/easy_install-5TSFFA/docutils-0.11/setup.cfg
Running docutils-0.11/setup.py -q bdist_egg --dist-dir /tmp/easy_install-5TSFFA/docutils-0.11/egg-dist-tmp-VU3vt7
warning: no files found matching 'MANIFEST'
warning: no files found matching '*' under directory 'extras'
warning: no previously-included files matching '.cvsignore' found under directory '*'
warning: no previously-included files matching '*.pyc' found under directory '*'
warning: no previously-included files matching '*~' found under directory '*'
warning: no previously-included files matching '.DS_Store' found under directory '*'
zip_safe flag not set; analyzing archive contents...
docutils.writers.docutils_xml: module references __path__
docutils.writers.html4css1.__init__: module references __file__
docutils.writers.s5_html.__init__: module references __file__
docutils.writers.pep_html.__init__: module references __file__
docutils.writers.latex2e.__init__: module references __file__
docutils.writers.odf_odt.__init__: module references __file__
docutils.parsers.rst.directives.misc: module references __file__
Adding docutils 0.11 to easy-install.pth file
Installing rst2latex.py script to /home/nueces/buildout.python-master/python-2.4/bin
Installing rst2s5.py script to /home/nueces/buildout.python-master/python-2.4/bin
Installing rst2odt_prepstyles.py script to /home/nueces/buildout.python-master/python-2.4/bin
Installing rst2xetex.py script to /home/nueces/buildout.python-master/python-2.4/bin
Installing rst2html.py script to /home/nueces/buildout.python-master/python-2.4/bin
Installing rst2odt.py script to /home/nueces/buildout.python-master/python-2.4/bin
Installing rstpep2html.py script to /home/nueces/buildout.python-master/python-2.4/bin
Installing rst2xml.py script to /home/nueces/buildout.python-master/python-2.4/bin
Installing rst2pseudoxml.py script to /home/nueces/buildout.python-master/python-2.4/bin
Installing rst2man.py script to /home/nueces/buildout.python-master/python-2.4/bin

Installed /home/nueces/buildout.python-master/python-2.4/lib/python2.4/site-packages/docutils-0.11-py2.4.egg
Finished processing dependencies for collective.dist
Installing python-2.4-PIL.
python-2.4-PIL: Running '
/home/nueces/buildout.python-master/parts/opt/bin/easy_install-2.4 -U "Pillow<2"'
/bin/sh: /home/nueces/buildout.python-master/parts/opt/bin/easy_install-2.4: not found
python-2.4-PIL: Non zero exit code (127) while running command.
While:
  Installing python-2.4-PIL.
Error: Non zero exit code (127) while running command.

The problem is that the setuptools installation via the ez_setup.py script fail for one issue with the SSL certificate of https://pypi.python.org/

This is the output of the command executed in a shell in a Lucid box.

$ wget https://pypi.python.org/packages/source/s/setuptools/setuptools-1.1.6.tar.gz --output-document /home/nueces/buildout.python-master/setuptools-1.1.6.tar.gz 
--2013-11-27 06:41:10--  https://pypi.python.org/packages/source/s/setuptools/setuptools-1.1.6.tar.gz
Resolving pypi.python.org... 199.27.77.184, 199.27.77.185
Connecting to pypi.python.org|199.27.77.184|:443... connected.
ERROR: certificate common name `*.a.ssl.fastly.net' doesn't match requested host name `pypi.python.org'.
To connect to pypi.python.org insecurely, use `--no-check-certificate'.

That create a empty setuptools-1.1.6.tar.gz file in the buildout directory, so if we run the buildout again the error now is:

python-2.4: Running 
/home/nueces/buildout.python-master/parts/opt/bin/python2.4 /home/nueces/buildout.python-master/src/ez_setup.py
/home/nueces/buildout.python-master/parts/opt/bin/easy_install-2.4 pip==1.1
/home/nueces/buildout.python-master/bin/virtualenv-2.4 --system-site-packages /home/nueces/buildout.python-master/python-2.4
/home/nueces/buildout.python-master/python-2.4/bin/easy_install -U collective.dist
Extracting in /tmp/tmpzGG-K3
Traceback (most recent call last):
  File "/home/nueces/buildout.python-master/src/ez_setup.py", line 370, in ?
    sys.exit(main())
  File "/home/nueces/buildout.python-master/src/ez_setup.py", line 367, in main
    return _install(tarball, _build_install_args(options))
  File "/home/nueces/buildout.python-master/src/ez_setup.py", line 60, in _install
    subdir = os.path.join(tmpdir, os.listdir(tmpdir)[0])
IndexError: list index out of range
/bin/sh: /home/nueces/buildout.python-master/parts/opt/bin/easy_install-2.4: not found

and that because the tmpdir is empty.

Log history short, there is a workaround just installing "curl", because it has precedence over "wget" in the function "get_best_downloader" of the ez_setup.py script. So I also added it as a dependency in the docs/INSTALL.txt.

I also added a test in the src/test-python.py file to check the if the python2.4 installed have SSL support.

[fschulze]

I don't see any recent changes in your repository. I would like to see the changes you did, they sound very useful.