|Location:||Bristol, CTLong Term|
Title: Data Engineer with SpringBoot
Location: Bristol, CT
Duration: 6 months+ extensions
- 3+ years working experience with Spark, Hive, Message Queue or Pub/Sub, Streaming technologies
- 6+ years of experience developing data pipelines using mix of languages (Python, Scala, SQL etc.) and open source frameworks to implement data ingest, processing, and analytics technologies
- Experience leveraging open source big data processing frameworks, such as Apache Spark, Hadoop and streaming technologies such as Kafka
- Hands on experience with newer technologies relevant to the data space such as Spark, Airflow, Apache Druid, Snowflake (or any other OLAP databases).
- Experience developing and deploying data pipelines and real-time data streams within a cloud native infrastructure preferably AWS
- Proven strength in SQL, data modeling, and data warehousing.
- Experience with Git, Continuous Integration and related tools
- Good unit testing and integration testing skills
- Experience with open source such as Spring, Hadoop, Spark, Kafka, Druid, Kubernetes