Data Engineer
Indegene
This job is no longer accepting applications
See open jobs at Indegene.See open jobs similar to "Data Engineer" Brighton Park Capital.Job Description
Must Have
Must Have
Role: Data Engineer
Description:
We are looking for experienced Snowflake engineers
• In-depth knowledge of Snowflake’s data warehousing capabilities.
• Understanding of Snowflake’s virtual warehouse architecture and how to optimize performance and cost.
• Proficiency in using Snowflake’s data sharing and integration features for seamless collaboration.
• Experience with dimensional modeling for data warehousing
• Ability to design efficient database schemas that support analytical workloads
• Build scalable data enablement pipelines and solution for large scale cross functional applications/systems
Required knowledge:
• Ability to write complex SQL queries, stored procedures, and user-defined functions.
• Skills in optimizing SQL queries for performance and efficiency.
• Integrate AI models with Snowflake, AWS and other systems.
• Experience with ETL/ELT tools and techniques, including Snowpipe, AWS Glue, Kinesis, informatica cloud or similar tools for real-time and periodic data processing.
• Proficiency in transforming data within Snowflake using SQL and other tools.
• Strong understanding of data security, compliance and governance.
• Experience in Snowflake Data Warehousing, Data Sharing, Advanced SQL, Stored Procedures and user-defined functions
• Snowflake Query optimization skills, Snowflake Data Ingestion and Transformation using AWS
• Snowflake CI/CD pipelines
• Reference architecture including data ingestion on AWS
• Supplier should outline decision criteria that determine whether to leverage DBT
• Experience with DBT for database object modeling and provisioning,
• Strong experience with AWS services, Rest APIs, Authentication with Oauth2/OIDC/SAML, Object Stores like S3, Open Storage standards such as Iceberg or delta, query engines such as Spark, DuckDB or Polars
• develop and guide teams to build complex solutions on top. Preferably, you have also experience operating other an end-to-end data platform such as Palantir
Foundry, Databricks or Snowflake.
• Knowledge of agile implementation methods and common project tools (e.g., Azure Devops, Jira)
• Good documentation and coaching practice
• Ensure easily readable scripts and include proper commenting within scripts, as appropriate
Good to have
EQUAL OPPORTUNITY
This job is no longer accepting applications
See open jobs at Indegene.See open jobs similar to "Data Engineer" Brighton Park Capital.