How to run SQLAlchemy on AWS Lambda in Python

Question

I preapre very simple file for connecting to external MySQL database server, like below:

from sqlalchemy import *

def run(event, context):
    sql = create_engine('mysql://root:[email protected]/scraper?charset=utf8');
    metadata = MetaData(sql)

    print(sql.execute('SHOW TABLES').fetchall())

Doesn't work on AWS, but localy on Windows works perfectly.

Next, I install by pip install sqlalchemy --target my/dir and prepare ZIP file to upload packages to AWS Lambda.

Run, but with failed message No module named 'MySQLdb': ModuleNotFoundError.

Then, I use pip install mysqlclient --target my/dir, create ZIP and again upload to AWS Lambda.

Run, but with new failed message cannot import name '_mysql': ImportError.

So, what I should doing now?

It might be missing the MySQL client libraries. The python libraries afaik are wrappers around the C implementation. — danblack
– danblack, Commented Feb 8, 2019 at 1:45

I Bajwa PHD · Accepted Answer · 2019-02-08 12:38:06Z

5

SQLAlchemy includes many Dialect implementations for various backends. Dialects for the most common databases are included with SQLAlchemy; a handful of others require an additional install of a separate dialect.

The MySQL dialect uses mysql-python as the default DBAPI. There are many MySQL DBAPIs available, including MySQL-connector-python and OurSQL

Instead of mysql you may use mysql+mysqlconnector

sql = create_engine('mysql+mysqlconnector://root:[email protected]/scraper?charset=utf8')

Then use:

pip install mysql-connector --target my/dir

Create Zip and again upload to AWS Lambda.

answered Feb 8, 2019 at 12:38

I Bajwa PHD

1,7661 gold badge21 silver badges45 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

lowercase00 Over a year ago

I normaly instatiate ‘db = SQLAlchemy()’ and then use db.session, any idea on how would that work in this case?

Jinghui Niu Over a year ago

Should this be included as a layer? or the function code itself?

Collectives™ on Stack Overflow

How to run SQLAlchemy on AWS Lambda in Python

1 Answer 1

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related