Senior Data Engineer
The Senior Data Engineer is a highly visible role that establishes and maintains working relationships with different team members across the technology organization. As a Senior Data Engineer within the Data DevOps organization, you will lead and collaborate across Agile teams to design, develop, test, implement, and support technical solutions. Other responsibilities will include ongoing operations, platform, and data governance endeavors such as data retention, data quality, platform upgrades and continuous improvement initiatives. Essential Functions Work with Data Modelers to understand data warehouse models, design specifications, metadata process and documentation. Work with source system developers and business owners to define data extraction methodologies. Design, develop and document detailed ETL/ELT specifications based on business requirements. Collaborate with all global vendors to ensure data integration standards and best practices are enforced, thereby ensuring stability, scalability, transparency, and other key factors are incorporated into the solutions. Collaborate with Application/Solution/Enterprise/Infrastructure Architects on future needs. Define and document Software application modules in Informatica, Talend, Perl, SQL, and HIVE Work with development tools and team methodologies (Agile, GIT, test driven development, CI/CD release management) Execute deployment, support, maintenance, and continuous improvement initiatives Ability to work with other technical team members to assess needs, provide assistance, and resolve technical problems Communicate status / risks to manager regarding delivering solution on time Required Experience Bachelor's degree in Computer Science, Information Systems, Electrical Engineering or related field or equivalent work experience required Understanding of ETL/ELT development in the IT industry with recent development, system administration, application tuning and debugging experience 5
years development experience with database engines including Oracle, Mongo DB and Hadoop. 5
years' experience in ETL/ELT development Experience in Informatica or Talend ETL tool Experience in Unix and SQL Knowledge of database performance factors, monitoring tools and tuning procedures Understanding of SDLC and production environments. Strong verbal and written communication skills. Experience in 24/7 on-call support rotation. Preferred Experience Implemented best practices around Talend development methodology and experienced in building ETL prototypes using subjobs, joblets, and reusable components. Experienced in Talend Big Data edition (Talend Standard, Big Data Batch and Streaming jobs) and have developed pipelines using HDFS, Hive, Impala and Kafka platforms. Experience in working with Custom Java, Scala and PySpark usage with Talend Integration. Strong knowledge in performance tuning of Talend big data processes. Experienced in handling Kafka topics using Talend tool. Experience in HQL and database scripting (procedures, functions). Knowledge of CI/CD (Git/Jenkins).
Salary Range:
$80K -- $100K
Minimum Qualification
Data Science & Machine Learning, Systems Architecture & EngineeringEstimated Salary: $20 to $28 per hour based on qualifications.
years development experience with database engines including Oracle, Mongo DB and Hadoop. 5
years' experience in ETL/ELT development Experience in Informatica or Talend ETL tool Experience in Unix and SQL Knowledge of database performance factors, monitoring tools and tuning procedures Understanding of SDLC and production environments. Strong verbal and written communication skills. Experience in 24/7 on-call support rotation. Preferred Experience Implemented best practices around Talend development methodology and experienced in building ETL prototypes using subjobs, joblets, and reusable components. Experienced in Talend Big Data edition (Talend Standard, Big Data Batch and Streaming jobs) and have developed pipelines using HDFS, Hive, Impala and Kafka platforms. Experience in working with Custom Java, Scala and PySpark usage with Talend Integration. Strong knowledge in performance tuning of Talend big data processes. Experienced in handling Kafka topics using Talend tool. Experience in HQL and database scripting (procedures, functions). Knowledge of CI/CD (Git/Jenkins).
Salary Range:
$80K -- $100K
Minimum Qualification
Data Science & Machine Learning, Systems Architecture & EngineeringEstimated Salary: $20 to $28 per hour based on qualifications.
|
|
 | |
