Senior Data Platform Engineer (Four Years Contract)
Compnay Name
Petroleum Development Oman
Nationality Required
Omani
Education & Experience Required
Job Description
Description
The role of a Senior Data Platform Architect is to design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL principles and business goals. Responsible for improving and scaling the data lake and solving complex data problems to ensure the creation of a scalable, performance, accessible single source of truth. Additionally, advises, consults, mentors, and coaches others in the field.
Principal Accountabilities
• Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL principles and business goals.
• Advise, consult, mentor and coach other data and analytic professionals on data standards and practices.
• Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions.
• Lead the evaluation, implementation and deployment of emerging tools and process for analytic data engineering in order to improve data engineering and science productivity.
• Partner with enterprise and solutions architects to develop technical architectures for full integration of the central data platform in other applications and the infrastructure.
• Learn about machine learning, data science, computer vision, artificial intelligence, statistics, and/or applied mathematics to ensure availability of future capability requirements on the data platform
Requirements
• Bachelor's degree in computer science or information management with 10+ years’ experience in data and analytics management
• 8+ years of experience in data engineering and data platform management, preferably with digitally-native or digitally advanced organizations.
• Must have experience in the product and platform operating models.
• Must have experience in Digital Product and Platform.
• Hands-on experience in building, scaling and maintaining a data lake for a major corporation.
• Expertise in SQL and at least one programming language (Python, Scala, Java, R, etc.)
• Experience developing and maintaining in big data solutions for structured and un-structured data incl. real-time streaming (e.g., with Kafka).
• Experience with developing data solutions on cloud computing services and infrastructure
• Database development knowledge using e.g., Hadoop or BigQuery and knowledge of a variety of relational, NoSQL, cloud database technologies (e.g. Databricks or Snowflake)and demonstrate strong proficiency in modern data management tools.
• Experience in using data cataloging tools that leverages on metadata management to create inventory of data assets within an organisation Experience in Master Data Management technologies Familiar with BI tools such as Tableau, Power BI, Looker, Shiny.
• Exposure to integrating multi-Lakes or multiple Data Platforms environments using data virtualization tools (e.g. Microsoft Fabric, Denodo and etc.
• Strong conceptual knowledge of data and analytics, such as database design, dimensional modeling, ETL, reporting tools, data governance, data warehousing, structured and unstructured data.
• Exposure to machine learning, data science, computer vision, artificial intelligence, statistics, and/or applied mathematics.
Skills & Competencies:
• Passionate about Agile software processes, data-driven development, reliability, and experimentation.
• Experience working on a collaborative Agile product team.
• Familiarity with DevOps and Site Reliability Engineering (SRE) practices.
• Knowledge of continuous integration and delivery (CI/CD) pipelines.
• Self-motivated with strong problem-solving and learning skills.
• Flexibility to changes in work direction as the project develops
• Excellent communication, listening, and influencing skills.
• Strong track-record of mentoring peers in latest technologies & data best-practices.
• Demonstrated strong number sense, intellectually curious and willing to adjust position based on additional information.
• Strong work ethic; ability to work at an abstract level and gain consensus.
• Wants to unleash inner self-starter and work in an environment that fosters entrepreneurial minds.
• Believes in culture of brutal transparency and trust.
• Open to learning new ideas outside scope or knowledge
Competencies:
• M&T Architecture
• IM&T Data Engineer
• IM&T Analytics
• IM&T Landscape & Configuration Management
• IM&T Audit & Compliance
• IM&T IM Design Integrity
Skills Required
Other Job Details
Share on Facebook
Share on LinkedIn
