sean Thanks Sean,
I built my own openssl. If anyone else runs into this problem, this is what I did (Note: replace navin with your own username)
$ mkdir src && cd src && wget <openssl-url> && cd <openssl-directory>
$ ./config --prefix=/home/navin/opt/ssl --openssldir=/home/navin/opt/ssl && make && make install
Now install python:
$ cd src && wget <python-url> && cd <python-directory>
$ ./configure --prefix=/home/navin/opt --with-openssl=/home/navin/opt/ssl --with-openssl-rpath=auto && make && make install
This made everything work.