Import Python module into AWS Lambda

Question

I have followed all the steps in the documentation: https://docs.aws.amazon.com/lambda/latest/dg/lambda-python-how-to-create-deployment-package.html

create a directory.
Save all of your Python source files (the .py files) at the root level of this directory.
Install any libraries using pip at the root level of the directory.
Zip the content of the project-dir directory)

But after I uploaded the zip-file to lambda function, I got the error message when I test the script

my code:

    import psycopg2
    #my code...

the error:

    Unable to import module 'myfilemane': No module named 'psycopg2._psycopg'

I don't know where is the suffix '_psycopg' from...

Any help regarding this?

@KiteCoder You reminded me...I used windows system...I will try with Linux...thank you — wendybear
– wendybear, Commented Sep 20, 2018 at 8:39

Kannaiyan · Accepted Answer · 2018-09-19 17:22:11Z

You are using native libraries with lambda. We had this similar problem and here is how we solved it.

Spin a machine with AWS supported AMI that runs your real lambda.

https://docs.aws.amazon.com/lambda/latest/dg/current-supported-versions.html

As this writing, it is,

AMI name: amzn-ami-hvm-2017.03.1.20170812-x86_64-gp2

Full documentation in installing native modules your python lambda.

https://docs.aws.amazon.com/lambda/latest/dg/lambda-python-how-to-create-deployment-package.html

Install the required modules required for your lambda,

pip install module-name -t /path/to/project-dir

and prepare your package to upload along with the native modules under lambda ami environment.

Hope this helps.

KiteCoder · Accepted Answer · 2018-09-19 16:35:31Z

0

I believe this is caused because psycopg2 needs to be build an compiled with statically linked libraries for Linux. Please reference Using psycopg2 with Lambda to Update Redshift (Python) for more details on this issue. Another [reference][1] of problems of compiling psycopg2 on OSX.

There are a few solutions, but basically it comes down to installing the library on a Linux machine and using that as the Psycopg2 Library in your upload package.

answered Sep 19, 2018 at 16:35

KiteCoder

2,4501 gold badge16 silver badges32 bronze badges

1 Comment

Code True Over a year ago

So for a 'serverless' application (where lambda is the only desired service) one needs to use/pay-for a separate aws server in order to import modules like 'pymongo'?

Collectives™ on Stack Overflow

Import Python module into AWS Lambda

2 Answers 2

1 Comment

1 Comment

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

1 Comment

Linked

Related