As a Solution Architect - Snowflake, you will play a crucial role in designing, building, and maintaining scalable data pipelines and infrastructure
You will work with a variety of technologies, including Scala, Python, Spark, AWS services, and SQL, to support our data processing and analytics needs
Responsibilities: - * Collaborate with stakeholders to finalize the scope of enhancements and development projects, gather detailed requirements
* Apply expertise in ETL/ELT processes and tools to design and implement data pipelines that fulfil business requirements
* Provide expertise as a technical resource to solve complex business issues that translate into data integration and database systems designs
* Migrate and modernize existing legacy ETL jobs for Snowflake, ensure data integrity and optimal performance
* Analyze existing ETL jobs and identify opportunities for creating reusable patterns and components to expedite future development
* Develop and implement a configuration-driven Data Ingestion framework that enables efficient onboarding of new source tables
* Collaborate with cross-functional teams, including business analysts and solution architects, to align data engineering initiatives with business goals
* Drive continuous improvement initiatives, enhance data engineering processes, tools, and frameworks
* Ensure compliance with data quality, security, and privacy standards across all data engineering activities
* Participate in code reviews, provide constructive feedback, and ensure high-quality, maintainable code
* Prepare and present technical documentation, including data flow diagrams, ETL specifications, and architectural designs
) and relevant technical certification in multiple technologies is desirable
Skills:Mandatory Technical Skills:- * Should have strong experience in Snowflake and must have executed development and migration projects involving Snowflake * Should have strong working experience in ETL tools (Matillion/ DBT/Fivetron/ADF preferably) * Experience in SQL writing including flatten tables and experience in JSON will be good to have, and able to write complex queries
* Strong understanding of SQL queries, good coding experience on Python, deploying into Snowflake data warehousing, pipelines * Experience in large databases * Working knowledge of AWS (S3, KMS, and more) or Azure/GCP * Design, develop, and thoroughly test new ETL/ELT code, ensure accuracy, reliability, and adherence to best practices * Snowflake * Python/Spark/JavaScript * AWS/Azure/GCP * SQLGood to have skills:- * CI/CD (DevOps) * Terraform/AirflowOur commitment
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Solution ArchitectEmployement Type: Full time