how to import numpy and pandas inside aws lambda function

0 votes

i need to process csv file using numpy and pandas , i could do it in local machine its running as a expected manner then i am trying to do the same thing in aws lambda function with the same code i was used in my local machine.i am trying to import numpy inside my aws lambda function but error was thrown as Unable to import module 'aws_lambda_demo/lambda_function': No module named 'numpy'. then i create a zip file with aws lambda function along with numpy package after that also facing same issue Unable to import module 'aws_lambda_demo/lambda_function': No module named 'numpy'. Notes: i kept my csv files in s3 storage .any help will be appreciated . thanks in advance.

Sep 17, 2018 in AWS by bug_seeker
• 15,520 points
9,382 views

2 answers to this question.

0 votes

The problem is that your local numpy and pandas are compiled for the local machine's architecture. Since AWS Lambda uses custom Linux, they are probably not compatible.

So if you want to use them, you have two choices:

  • Compile dependencies on EC2 instance which uses the same Amazon Linux version as AWS Lambda and create a deployment package.

  • Use one of the precompiled packages from here

answered Sep 17, 2018 by Priyaj
• 58,100 points

Dude... i followed the same... but there's use... of this way... https://www.thetechnologyupdates.com/aws-lambda-layers-tutorial/?unapproved=812&moderation-hash=cd0a7d0bbf3a7f3d924c0860a35945a3#comment-812 used this link and did the same ... but the error in lambda is 

Unable to import module 'lambda_function': Missing required dependencies ['numpy']

Hey @Sunil, follow these instructions:

upload your deployment package to the following repo:

git clone https://github.com/pbegle/aws-lambda-py3.6-pandas-numpy.git

Add your lambda_function.py to the zip file by running:

zip -ur lambda.zip lambda_function.py

Upload to S3 and source to lambda.

Hi The option to package the code using dependencies at the git hub location https://mflb.s3.ap-south-1.amazonaws.com/lambda.zip worked for me. Thanks for having these dependencies archived. Kudos

+1 vote
I had good luck using pre-made pandas and numpy layers that allowed me to skip a lot of the docker and pip solutions I saw elsewhere. This is what worked for me: https://medium.com/@melissa_89553/how-to-import-python-packages-in-aws-lambda-pandas-scipy-numpy-bb2c98c974e9
answered Nov 3, 2020 by anonymous

reshown Nov 3, 2020 by Sirajul

Related Questions In AWS

0 votes
2 answers

how to import numpy and pandas inside aws lambda function?

this approach worked for me: https://medium.com/@melissa_89553/how-to- ...READ MORE

answered Oct 10, 2020 in AWS by anonymous
11,367 views
0 votes
3 answers

How to check instance state and status via Lambda function in AWS?

import boto3 from pprint import pprint def lambda_handler(event, context):          # ...READ MORE

answered Sep 8, 2020 in AWS by Shrikant
• 180 points
10,295 views
0 votes
1 answer

How to link AWS Lambda function to Amazon CloudWatch ?

In order to create Log Group and ...READ MORE

answered Jul 20, 2018 in AWS by datageek
• 2,540 points
1,498 views
0 votes
1 answer

Is AWS Lambda code isolated to others and how?

AWS Lambda functions execute in a container ...READ MORE

answered Jan 22, 2019 in AWS by Fitinai
690 views
0 votes
1 answer

how to access AWS S3 from Lambda in VPC

With boto3, the S3 urls are virtual by default, ...READ MORE

answered Sep 28, 2018 in AWS by Priyaj
• 58,100 points
10,056 views
0 votes
2 answers
0 votes
1 answer
0 votes
1 answer
0 votes
2 answers

How do I add python libraries to an AWS lambda function for Alexa?

If you get lucky (it depends what ...READ MORE

answered Nov 3, 2020 in AWS by anonymous
15,464 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP