Senior Data Engineer
IT- Other
AtlantaGA Contract Sep 27, 2024
Sr. Data Engineer
6-month Contract – High Likelihood of Extensions!!!
100% Remote (EST) – Ideal locations Atlanta or Philadelphia Areas


Overview:?
Our client, a Data Analytics company is seeking a Senior Data Engineer to support a critical 2 phase project. This is an intitial 6 month engagement with possibility to extend. 100% remote, but ideal location would be Atlanta or Philadelphia areas.
 
 
Summary:  The Senior Data Engineer will be a critical resource helping to deliver a cutting-edge data solution for customer reports that will make an immediate impact on Q4'24 and FY'25 revenue. This high-visibility project requires an experienced Senior Data Engineer to build a scalable data ingestion engine and automate processes for efficient report generation and delivery. If you're passionate about working with large datasets, have strong SQL, Snowflake and Python skills, and thrive in dynamic, fast-paced environments, this is a great opportunity for you!
 
Key Responsibilities:
  • Lead the development of a data ingestion engine using Snowflake as the primary database solution.
  • Automate data transformations and reporting processes for seamless integration into our internal and external systems.
  • Collaborate with project stakeholders to define requirements and implement scalable ETL pipelines using Python.
  • Manage lightweight project tasks, track report attributes, and communicate project progress effectively to both technical and non-technical teams.
  • Ensure data accuracy and quality by performing manual and automated validation of codes and report attributes.
  • Design, create, and maintain SQL queries to generate reports that meet product specifications.
  • Integrate reporting processes with Marketscape Admin for automated code validation and data management.
  • Automate report delivery, ensuring they are uploaded to the appropriate server locations and that clients are notified promptly.
  • Implement automated quality assurance (QA) checks to ensure data consistency and integrity throughout the pipeline.

Qualifications:
  • 5+ years of experience as a Data Engineer, with a focus on SQL, ETL, and Snowflake databases.
  • Proven expertise in Python for data manipulation and ETL development.
  • Experience working with large, structured datasets and transforming raw data into customer-facing reports.
  • Knowledge of Snowflake share data exchange and ingestion processes.
  • Prior experience working on high-impact projects with immediate revenue implications.
  • Strong communication skills and the ability to manage lightweight project tasks.
  • Familiarity with report file management, and data delivery protocols.
  • Experience with QA and automated testing for data quality.
  • Ability to work independently while coordinating effectively with cross-functional teams.


#LI-REMOTE 
#LI-QH1