How to Install Scrapy in 64-bit Windows 7

From steamWiki
Revision as of 21:33, 23 November 2018 by Sean (talk | contribs)

Jump to: navigation, search

Notes

  • Scrapy must be installed with Python 2.5, 2.6, or 2.7 (NOT 3.x)
  • Python 2.7 (and 3.2) do not load the correct 32-bit compatible Windows Registry Keys


Install Procedure

  1. Download & install Python 2.7.2 (using the Windows Installer) from http://www.python.org/getit/
  2. Go to the Search programs and files bar at the bottom of the start menu and type "regedit" and hit enter
  3. Using the left pane navigate to "HKEY_LOCAL_MACHINE\SOFTWARE\Python" & click on it (highlighting it in blue)
    1. With the branch selected go to File --> Export
    2. Save the file somewhere you can get to it easily
    3. Open the file in your favorite text editor
    4. Insert "\Wow6432Node" inbetween "SOFTWARE" and "\Python" on every line (an easy way to do this is to do a find and replace with "SOFTWARE" in the Find Field and "SOFTWARE\Wow6432Node" in the Replace Field
    5. Save the file
    6. Navigate to where you saved said file and double click on it to initiate a Registry Modification
  4. Now download the Scrapy 0.14 Windows installer from http://pypi.python.org/pypi/Scrapy
  5. Double click the Scrapy Installer and everything should work fine.
  6. Download and install Twisted 11.1.0 for Python 2.7 64 bit from http://twistedmatrix.com/trac/wiki/Downloads
  7. Download and install Zope.Interface
    1. Download distribute_setup.py from http://python-distribute.org/distribute_setup.py (right click & save), then double click it to install
    2. Download zope.interface-3.8.0-py2.6-win-amd64.egg from http://pypi.python.org/pypi/zope.interface/3.8.0#downloads
    3. Open a command prompt (type "cmd" into the same Search programs and files pane as above) and navigate to your Python Scripts folder (something like "cd C:\Python27\Scripts")
    4. type "easy_install C:\Downloads\zope.interface-3.8.0-py2.6-win-amd64.egg" (replacing C:\Downloads\ with wherever you downloaded Zope.Interface to) and hit enter
  8. Download and install lxml-2.3.2.win-amd64-py2.7.‌exe from http://www.lfd.uci.edu/~gohlke/pythonlibs/
  9. Download and install egenix-pyopenssl-0.13.0_1.0.0g_1.win-amd64-py2.7.msi from http://www.egenix.com/cryptodownload/?file=egenix-pyopenssl-0.13.0_1.0.0g_1.win-amd64-py2.7.msi
    • When it asks you to navigate to a Python 2.6 Directory, just point it to your Python 2.7 Directory (C:\Python27 by default)
  10. Install w3lib
    1. Open a command prompt (Start -> Search programs and files -> "cmd")
    2. Navigate to your Python Scripts Folder (nominally "C:\Python27\Scripts")
    3. Type "easy_install w3lib" and hit enter
  11. Now we just need to add the Python Scripts folder to the System Path so we can use scrapy
    1. Click the "Start Menu" button and Right Click on "Computer" and select "Properties"
    2. Click "Advanced system settings" in the left bar
    3. Click "Environment Variables..."
    4. Find the "Path" variable in the (lower) System variables Pane and double click on it
    5. Click in the "Variable value:" pane and hit the "End" button
    6. Type, or paste, ";C:\Python27\Scripts\" (modify for wherever you installed Python) at the end of the line
      • Be sure not to disturb or change any of the existing information there
    7. Hit OK, OK,OK, X
  • You MIGHT have to install PyWin32. I did so in an effort to fix another problem as it was recommended by the Scrapy Installation Guide. Although it didn't fix the problem I was targeting it may have prevent other problems from arising. Install PyWin32 if you are having problems
    1. Download pywin32-216.win-amd64-py2.7.exe from http://sourceforge.net/projects/pywin32/files/pywin32/Build216/
    2. Double click the downloaded file & install the software

References

Retrieved from "https://steamforge.net/wiki/index.php?title=How_to_Install_Scrapy_in_64-bit_Windows_7&oldid=1009"