Job Description
Key Accountabilities
Data Infrastructure Development:
Design, build, and maintain efficient and scalable pipelines to support ingestion, transformation, and storageDevelop and optimize ETL processes to ensure timely and accurate data availability for analytics and BI
Implement data quality and validation processes to ensure the integrity and reliability of data
Data Management:
Manage and monitor data systems to ensure high availability, reliability, and performance.
Maintain comprehensive documentation of data infrastructure, processes, and systems.
Troubleshoot and resolve data-related issues, ensuring minimal disruption to business operations.
Collaboration and Support:
Work closely with trading analysts and IT to understand data requirements and deliver solutions
Provide support to trading analysts by ensuring they have access to clean, well-structured data
Innovation and Improvement:
Stay updated with the latest trends and technologies in data engineering and implement best practices to enhance data infrastructure.
Continuously evaluate and improve existing data pipelines and systems to increase efficiency and scalability.
Identify opportunities for automation and implement solutions to reduce manual data handling tasks.
Education, Experience & Skill Requirements
Extensive training in computer science, engineering, data science, or a related field
5+ years of relevant work experience in data engineering, data management, or a related role
Strong proficiency in programming languages such as Python, SQL, and experience with data processing frameworks like Apache Spark or Hadoop
Experience with cloud platforms such as AWS, Google Cloud, or Azure, and familiarity with data warehousing solutions like Snowflake or Redshift
Excellent problem-solving skills and attention to detail, with a focus on data quality and reliability.
Strong communication and teamwork skills, with the ability to collaborate effectively with data scientists, analysts, and other stakeholders
A keen interest in the energy trading sector and a commitment to staying updated with industry trends and developments
Key Metrics
Successful design, development, and maintenance of robust data pipelines and systems
High availability, reliability, and performance of data infrastructure, as evidenced by key performance indicators (KPIs)
Effective support and collaboration with data scientists, analysts, and other stakeholders.
Continuous improvement in data processing efficiency and scalability
TXU Energy
1601 Bryan St
Dallas
Texas United States
www.txuenergy.com
