● Education: BCA/MCA, BE/Btech in Computer Science,
● Technical Skills: Python, Snowflake, Pyspark, Kubernetes, Cloud technologies, Apache Kafka, Apache Spark, Pandas, Polars, Git, Docker.
● Experience: 10+ years of experience in software development, including 5+ years in a managerial role.
● Soft Skills: Great communication and team leadership skills
● Location – Guwahati
● Knowledge: Strong technical background with expertise in:
○ Core Data Engineering Skills (Data Architecture and Modelling, Big Data Technologies, Cloud Platforms)
○ Key technologies: Snowflake or Databricks
○ Programming & Scripting: (Languages: Python, SL, Scala or Java & Scripting: Bash, PowerShell, or other scripting languages for automation and deployment)
○ DevOps & CI/CD in Data Engineering (Familiarity with CI/CD tools like Jenkins, GitLab CI/CD, or Azure DevOps, Containerization tools like Docker and orchestration platforms like Kubernetes, Monitoring and logging tools (e.g., Prometheus, Grafana, Datadog)
○ Data Quality: data profiling techniques, building and integrating data quality frameworks into ETL/ELT pipelines, tools like Great Expectations, Apache Griffin, or DQ frameworks, expertise in defining and implementing data quality metrics, Knowledge of anomaly detection techniques and leveraging AI/ML for predictive data quality assurance, collaboration with business stakeholders to define data quality rules and maintain comprehensive documentation.
○ Data Governance and Security: Understanding of data privacy regulations (e.g., GDPR, CCPA)., implementing data governance tools and frameworks like Collibra or Alation, setting up RBAC (Role-Based Access Control), encryption, and auditing for data systems.