Digital Solutions - Data Engineer

LightBox

1d

About The Position

As a Digital Solutions Data Engineer at LightBox, you will be responsible for designing, building, validating, and delivering data solutions to our customers.
You will collaborate with a highly motivated team of experienced data and software engineers, focusing on data creation, quality assurance, modeling, and architecting to address diverse use case scenarios. Your role involves developing scalable data ingestion pipelines, maintaining processes for ingesting, building, and validating spatial datasets, and leveraging your expertise in database management and Python to enhance client data solutions and ensure high-quality outputs. Data is typically delivered as standalone deliverables or within defined LightBox or client software environments.
LightBox data solutions are created using client data inputs, the LightBox data platform, and industry-standard GIS and data transformation/enrichment toolsets. These solutions provide property insights to the lending, insurance, real estate, environmental, and government sectors.

Requirements

• Bachelor’s degree or certificate in GIS, Geography, Computer Science, or a related discipline.
• Strong academic record with a solid foundation in GIS and Data Engineering.
• Familiarity with GIS standards, principles, best practices, open-source tools, and public domain data.
• 2-5 years of experience as a GIS Analyst, Data Engineer, or Data Analyst (qualified recent graduates will also be considered).
• Outstanding organizational, communication, analytical, and interpersonal skills.
• Ability to quickly understand technical products and explain concepts to non-technical audiences.
• Experience with project management techniques like Agile and Scrum.
• Proven track record of meeting deadlines and managing multiple varied tasks.
• Fundamental knowledge in SQL (spatial), Python, ETL, and data management to aggregate, gather, manipulate, or validate data.
• Proficiency with GIS software packages and open-source tools (e.g., QGIS, ESRI, GRASS, GDAL, OGR).
• Experience utilizing Python modules, packages, and libraries.
• Experience with pipeline orchestration technology (e.g., Prefect, AirFlow).
• Proficiency with pipeline transformation tools, using Python and the Pandas library.
• Scripting experience.
• Ability to document workflows concisely.
• Commitment to exceeding assigned tasks and project expectations.
• Experience with cloud infrastructure (AWS), Git, Docker, Apigee, and Kubernetes.
• Has knowledge of data security best practices (when handling sensitive data).
• Keen interest in data engineering with a “tinkering” mindset.
• Excellent interpersonal, written, and oral communication skills.
• Driven to continually learn about and incorporate new technologies.
• Experience with implementing new technologies and continuous improvement of processes and workflows
• Thrive in a self-driven environment.
• Understanding and integrating human and machine workflows.
• Team player with the ability to work collaboratively and take on new tasks.
• Reliable problem solver with the ability to work efficiently and independently.
• Embraces challenges with a positive attitude.
• Passion for learning new concepts and skills.

Nice To Haves

• 3+ years of experience in database design, data manipulation, and/or software engineering roles using SQL Server or similar RDBMS environments, including proficiency in stored procedures, views, optimizing queries and processes and ETL processes (Extract, Transform, Load).
• Proven experience in developing complex SQL queries to generate datasets for customers.
• Experience maintaining data quality across all stages of acquisition and processing, from data sourcing/collection to normalization and transformation.

Responsibilities

• Fulfill LightBox’s custom data deliveries to clients.
• Develop an in-depth understanding of LightBox data assets, infrastructure, and software, such as LandVision and SpatialStream.
• Analyze use cases and propose solutions to meet business objectives.
• Assess client requirements and develop data/software solutions accordingly.
• Model and architect data to address business problems.
• Analyze and resolve technical data and application issues.
• Create and maintain data pipelines to prepare and manage data for specific use cases.
• Develop, test, and document automated ETL (extract, transform, load) processes to meet business needs.
• Adhere to high-quality development principles while delivering solutions on time and within budget.
• Migrate existing workflows to newer infrastructures.
• Utilize SQL, ESRI ArcGIS, and other open-source GIS software to transform, enrich, and extend LightBox data assets for client delivery.
• Document data processing methodologies, best practices, and workflows concisely.
• Aggregate data from various sources and apply analytical techniques to uncover valuable insights and solve complex issues.
• Provide support, troubleshooting, modifications, enhancements, and maintenance for existing geospatial data processing scripts and tools.
• Develop data acceptance criteria, quality assurance plans, and automated testing routines.
• Investigate data-related issues and develop resolutions.
• Create tools and workflows to automate existing processes.

What This Job Offers

• Job Type: Full-time
• Career Level: Entry Level