JOB SUMMARY
The Data Engineer role will provide critical support to stakeholders of supported applications and to other members of the Business Process & Innovation team. This role will be responsible for developing data management and governance processes, creating and supporting automated data pipelines and executing data cleanup for applications supported by the team. This position requires a strong blend of collaboration, technical proficiency, and problem-solving abilities to ensure data accessibility, quality and reliability.
JOB RESPONSIBILITIES
- Design, develop and maintain robust and scalable data pipelines to ingest, process and store large volumes of structured and unstructured data
-
Collaborate with cross-functional teams to understand data requirements and translate them into technical specifications
-
Implement and optimize ETL (Extract, Transform, Load) processes to ensure efficient data flow and transformation
-
Endure data quality and integrity by implementing data validation an cleansing processes
-
Monitor and troubleshoot data pipeline performance, identifying and resolving issues proactively
-
Develop and maintain data models and schemas to support analytics and reporting needs
-
Work with cloud-based and on-prem data platforms and tools to manage and process data efficiently
-
Stay up to date with emerging data engineering technologies and best practices to drive continuous improvement
-
Ensure compliance with data governance and security policies
JOB REQUIREMENTS
Education Requirements:
- Bachelor's degree in computer science, Engineering, Information Technology or a related field. Advanced degrees are a plus.
Experience Requirements:
-
Experience in data engineering, software development, or a related field
-
Proven experience with data pipeline tools
-
Experience with SQL and database technologies
-
Experience with big data tools and technologies
-
Familiarity with cloud data platforms (AWS, Azure)
Knowledge, Skills & Abilities:
-
Proficiency in programming languages such as Python or Java
-
Strong understanding of data warehousing concepts and best practices
-
Experience with data modeling, architecture and integration
-
Excellent problem solving skills and attention to detail
-
Strong communication skills
-
Ability to work with a broad team
-
Knowledge of data security and privacy best practices
-
Familiarity with machine learning and AI tools is a plus
Southern Company
30 Ivan Allen Jr Blvd NW
Atlanta
Georgia États-Unis
www.southerncompany.com
