Lead Data Engineer
Cox Automotive
North Druid Hills, GA, United States
North Druid Hills, GA, United States
- IT
- Full-time
- Lead Data Engineer
- data processing
- data validation
The Lead Data Engineer processes and validates diverse data types, develops scalable data products, and supports enterprise-level data solutions. They participate in Agile planning, provide technical guidance, and monitor emerging data technologies to enhance team effectiveness. This role requires expertise in data processing frameworks, data quality tools, and enterprise data platforms within a collaborative and evolving technology environment.
The Lead Data Engineer is responsible for processing structured and unstructured data, validating data quality, and developing and supporting data products. The Senior Data Engineer also plays a role in Agile planning, providing advice and guidance, and monitoring emerging technologies.
WHAT YOU'LL DO
KEY RESPONSIBILITIES:
Process Structured and Unstructured Data
Data Validation and Quality
Agile Planning
Product Development
Application Support
Advice and Guidance
Emerging Technology Monitoring
WHO YOU ARE
QUALIFICATIONS:
PREFERRED QUALIFICATIONS:
USD 108,800.00 - 181,400.00 per year
Compensation:
Compensation includes a base salary of $108,800.00 - $181,400.00. The base salary may vary within the anticipated base pay range based on factors such as the ultimate location of the position and the selected candidate's knowledge, skills, and abilities. Position may be eligible for additional compensation that may include an incentive program.
Benefits:
The Company offers eligible employees the flexibility to take as much vacation with pay as they deem consistent with their duties, the company's needs, and its obligations; seven paid holidays throughout the calendar year; and up to 160 hours of paid wellness annually for their own wellness or that of family members. Employees are also eligible for additional paid time off in the form of bereavement leave, time off to vote, jury duty leave, volunteer time off, military leave, and parental leave.
WHAT YOU'LL DO
KEY RESPONSIBILITIES:
Process Structured and Unstructured Data
- Gathers and processes raw, structured, semi-structured, and unstructured data using batch and real-time data processing frameworks.
- Understands and enforces appropriate data master management techniques.
Data Validation and Quality
- Ensures data quality and implements tools and frameworks for automating the identification of data quality issues.
- Work with internal and external data providers on data validation providing feedback and making customized changes to data feeds and data mappings.
Agile Planning
- Understands the challenges that the analytics organization faces in their day-to-day work and partner with them to design viable data solutions.
- Recommends improvements to processes, technology, and interfaces that improve the effectiveness of the team and reduce technical debt.
Product Development
- Implements and optimizes data solutions in enterprise data warehouses and big data repositories.
- Installs, maintains, monitors, and supports business intelligence, distributed computation, and big data analytics tools.
Application Support
- Provides ongoing support, monitoring, and maintenance of deployed products.
Advice and Guidance
- Actively works with less experienced data engineers providing technical guidance and oversight.
Emerging Technology Monitoring
- Actively participates in the engineering community, staying up to date on new data technologies and best practices and shares insights with others in the organization.
WHO YOU ARE
QUALIFICATIONS:
- Must live within a commutable distance to Atlanta GA or be willing to relocate
- Bachelor's degree in Computer Science or related field and 6+ years related experience OR Masters Degree w/ 4+ years experience OR 18 years experience of equivalent combination of industry related professional experience and education.
- Working experience with batch and real-time data processing frameworks
- Strong working experience with data modelling, data access, schemas, and data storage techniques within Snowflake
- Working experience in design, development, and implementation of highly scalable, high-volume software systems and components, client-facing web applications, and major Internet-oriented applications and systems
- Working experience working with relational databases such as SQL, MySQL, Postgres/PostgreSQL
- Working experience with business intelligence tools and platforms
- Working experience with data quality tools
- Working experience with application lifecycle methodologies (e.g. waterfall, agile, iterative)
- Experience with ETL processes and tools
- Experience working with Git
- Experience or exposure to DBT
- Experience working with AI related tools such as co-pilot
- Experience implementing new tools into environments
PREFERRED QUALIFICATIONS:
- Scrum Developer Certification or equivalent
- Working experience with Sisense platform
- Working experience with SQL Server Integration Services
- Working experience with AWS data tools (Database Migration Service)
- Working experience with Python
- Experience working with Jira, Rally or similar tools
USD 108,800.00 - 181,400.00 per year
Compensation:
Compensation includes a base salary of $108,800.00 - $181,400.00. The base salary may vary within the anticipated base pay range based on factors such as the ultimate location of the position and the selected candidate's knowledge, skills, and abilities. Position may be eligible for additional compensation that may include an incentive program.
Benefits:
The Company offers eligible employees the flexibility to take as much vacation with pay as they deem consistent with their duties, the company's needs, and its obligations; seven paid holidays throughout the calendar year; and up to 160 hours of paid wellness annually for their own wellness or that of family members. Employees are also eligible for additional paid time off in the form of bereavement leave, time off to vote, jury duty leave, volunteer time off, military leave, and parental leave.
View this job in-app!
- Build trust with employers
- Fast-track job applications
- Stand out from the crowd
