Duke Energy is seeking a Data Engineer to join the Data & Analytics Solutions Team. The individual will help build new data pipelines, identify existing data gaps and provide automated solutions to deliver analytical capabilities and enriched data to applications. The data engineer will be responsible for obtaining data from the System of Record and establishing real-time dat afeed to provide analysis in an automated fashion.
Responsibilities
-
Develop Hadoop applications to analyze massive data collections
-
Develop processing framework to detect conditions
- Develop techniques supporting trending and analytic decision making processes
- Apply Hadoop technologies for responsive front-end experience
- Develop within security guidelines established
Working Conditions
-
This position must sit in Charlotte, NC
-
No travel
Basic/Required Qualifications
-
Graduation from a four-year college or university with a degree in computer science, engineering, mathematics, management of information systems, or related fields with one (1) year of work experience in addition to a degree, OR five (5) years of prior equivalent work related experience in lieu of a degree
Desired Qualifications
- 1-3 years of Hadoop experience (experience working on the Data and Analytics Solutions team)
- 1-3 years experience working with big data technologies
-
Digital Mindset/ Agile experience
-
1-3 years working with Hadoop platform
-
Hive Programing
- Sqoop (utilizing various data sources)
- Oozie workflows
- Spark/PySpark
- Hbase/Poenix
- Experience with NiFi a plus
- Hadoop File Formats e.g. ORC; Parquet; Avro)
- Self-starter who works with minimal supervision and the ability to work in a team of diverse skill sets
- Ability to comprehend customer requests and provide the correct solution
- Understanding of distributed computing principles
- Strong analytical mind to help take on complicated problems
- Desire to resolve issues and dive into potential issues
- Familiarity with the Agile Methodology
Click here to read the full job posting.
Duke Energy
526 S Church St
Charlotte
North Carolina United States
www.duke-energy.com
