Contact Us

Job Details

Software Engineer – Data

Full Time

Remote

Experience -

4-7+ years

Positions -

CTC-

Best In Industry

Job Description

We are seeking a highly skilled and passionate Senior Software Engineer (Data) to join our dynamic team. In this role, you will be instrumental in designing, developing, and maintaining robust and scalable data pipelines and infrastructure. If you’re a data enthusiast with a strong engineering mindset and a knack for solving complex data challenges, we encourage you to apply!

Roles and Responsibilities

  • Design, build, and optimize scalable data pipelines for ingestion, transformation, and loading of large datasets.
  • Collaborate with cross-functional teams to understand data requirements and deliver high-quality data solutions.
  • Implement data quality checks and monitoring to ensure data integrity and reliability.
  • Develop and maintain data models, ensuring efficient storage and retrieval.
  • Troubleshoot and resolve issues related to data pipelines and data infrastructure.
  • Contribute to the continuous improvement of our data platform and best practices.

Required Skills & Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
  • 4-7  years of dedicated experience in data engineering.
  • Strong proficiency in Python with a deep understanding of Object-Oriented Programming (OOP) concepts
  • Expertise in SQL for complex data querying, manipulation, and optimization.
  • Solid grasp of data engineering concepts, including data warehousing, ETL/ELT, data modeling, and distributed systems.
  • Hands-on experience with Databricks, including familiarity with Unity Catalog and key features like Delta Lake, notebooks, and job orchestration.
  • Proven hands-on experience with PySpark for large-scale data processing and analysis.
  • Basic understanding of Azure Cloud Services, particularly those relevant to data storage and processing.

Preferred Qualifications

    • Experience with Spark streaming frameworks (e.g., Structured Streaming).
    • Familiarity with Kafka for real-time data ingestion and processing is a plus.
    • Experience with Azure Data Factory is a plus.
Apply Now

Related Jobs

Open positions:

|

Experience:

Data Engineer/Backend Developer (Python)

Guwahati

Know More

Stories from our people

Hear inspiring stories about their professional journey and
life at this open, inclusive workspace.

  • passion, techjourney

Let’s take risks and follow our passion

Hi, this is Sonali, and I am an MBA graduate from Tezpur University. While in my final semester, I got placed in one of India’s ... read more
View More Stories