company_logo

Data Engineer

SparkCognition

Updated on: 03 August 2024

Additional Details

Work Location

Bengaluru, India

location

Job Type

FTE

job_type

Batch

Experience

batch

Stream Required

With desired skills

stream

Salary

12 LPA (Expected)

salary

Job Description

Position Summary:

SparkCognition’s Renewable Suite is the world's leading AI enabled SaaS platform that provides asset performance management and prescriptive analytics software to ever growing renewable energy power plants by combining the power of machine learning, big data, and deep domain expertise. Our platform works across multiple asset types such as wind, solar, storage and DC coupled assets to offer insights to our customers across their fleets. As a Data Engineer you will be working closely with team members across domains with deep technical skills and passion for clean energy.

Join us in:

  • Bringing large volumes of data from wind, solar, storage sites to cloud
  • Architecting scalable data ETL and MLOps pipelines and workflows 
  • Work on engineering projects to design, construct, install, test and maintain highly scalable data management systems

You’ll have:

  • Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. 
  • Experience with Python
  • 2+ years of experience building and optimizing ‘big data’ data pipelines, architectures 
    and data sets. Startup experience a plus
  • Experience building ETL pipelines from large disconnected datasets. 
  • Experience with big data tools: Hadoop, Spark, Kafka, etc. 
  • Experience with relational databases such as Postgres
  • Experience with Elasticsearch a plus

It would be great if you had: 

  • Experience in renewable energy or IoT time series data
  • Experience in workflow orchestration technologies like Airflow or Prefect
  • Experience with AWS cloud services: EC2, EMR, S3, RDS, Redshift or experience with GCP

Disclaimer: The Job Company is an independent platform dedicated to providing information about job openings. We are not affiliated with, nor do we represent, any company, agency, or agent mentioned in the job listings. Please refer to our Terms of Services for further details.

Click on the Apply Now button to apply for SparkCognition