Engineer II – Big Data / ETL Engineer (Apptio)
About The Position
DS Technologies Inc is looking for an Engineer II – Big Data / ETL Engineer (Apptio) role for one of our premier clients. We are a company that provides innovative, transformative IT services and solutions. We are passionate about helping our clients achieve their goals and exceed their expectations. We strive to provide the best possible experience for our clients and employees. We are committed to continuous improvement and innovation, and we are always looking for ways to improve our services and solutions. We believe in working collaboratively with our clients and employees to achieve success. We are looking for a highly skilled Big Data / ETL Engineer who can work as a standalone developer and write production-ready code from scratch. The ideal candidate has strong expertise in Python, SQL, ETL development, and data warehousing, with hands-on experience building scalable data pipelines in enterprise environments.
Requirements
- Strong Python (ETL pipeline development from scratch)
- Expert SQL and RDBMS concepts
- MS SQL Server (SSIS, SSRS)
- Oracle PL/SQL
- Solid understanding of OOP principles
- Apptio experience
- Airflow (DAG development)
- Experience with Data Warehousing & Big Data
- Node.js, JSON, and NoSQL databases
- Ability to work as an independent contributor
- Must be local to NYC metro area
Nice To Haves
- PySpark / Apache Spark
- Databricks Delta Lakehouse or BigQuery
- Exposure to cloud-based business tools and platforms
Responsibilities
- Design, develop, and maintain ETL pipelines using Python from scratch
- Write efficient, reusable, and scalable code following OOP principles
- Develop and optimize complex SQL queries, stored procedures, and database objects
- Perform data modeling including schemas and entity relationships
- Build and manage Airflow DAGs
- Ingest, cleanse, govern, and report data from Big Data platforms
- Work with multiple SQL dialects (SQL Server, Oracle, DB2, PostgreSQL)
- Collaborate with stakeholders while operating independently
Benefits
- Flexible work from home options available.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Career Level
Mid Level
Education Level
No Education Listed
