Python Developer

Vigna Solutions - Atlanta, GA

Full-time

Atlanta, GA

Professional, Scientific, and Technical Services

About the position

The Python Developer role involves designing and developing data-driven applications, optimizing database systems, and managing data workflows. The position requires expertise in various technologies including Django ORM, Hadoop, and AWS, with a focus on data engineering and application framework development.

Responsibilities

• Conduct data flow analysis, data modelling, and physical database design.
• Design and develop forms and handle data conversion processes.
• Perform performance analysis and tuning to optimize database systems.
• Achieve super-user level expertise with Adaptive Metadata Manager, mastering metamodels and developing load templates for business and technical metadata.
• Develop enterprise application frameworks and components to accelerate complex software development projects, including advanced business intelligence technology.
• Optimize search indexes through Django ORM enhancements.
• Develop modules to build Django ORM queries that pre-load data, reducing the number of database queries needed.
• Install and manage Hadoop, MapReduce, HDFS, AWS, and develop MapReduce jobs in PIG and Hive for data cleaning and pre-processing.
• Manage datasets using Panda data frames and MySQL, and query MySQL databases using Python-MySQL connector and MySQL dB package.
• Generate Python Django forms to record data of online users and use Pytest for writing test cases.
• Automate workflows using Python scripts and UNIX shell scripting.
• Create, activate, and program in Anaconda environments.
• Utilize Python unit and functional testing modules such as unit test, unittest2, mock, and custom frameworks in line with Agile Software Development methodologies.
• Clean and process third-party spending data into deliverables using Excel macros and Python libraries such as Numpy, SQL Alchemy, and matplotlib.
• Use Amazon Cloud EC2 along with Amazon SQS to upload and retrieve project history.

Requirements

• Proven experience in data engineering and related fields.
• Expertise in Adaptive Metadata Manager and metamodel development.
• Strong proficiency in Django ORM, Hadoop, MapReduce, HDFS, AWS, and related technologies.
• Experience with Python, MySQL, and data management tools.