Blog


HadoopSparkPythonScalaHDFSMapReduceHivePigImpalaKafkaSolrSnowflakeAWSOpenShiftDockerKubernetesDevOpsPySparkKudu

As a Data Solutions Developer in our company, your role will involve developing and implementing data solutions using big data technologies and cloud infrastructure.

**Responsibilities:**
- Build and maintain data pipelines using the Hadoop ecosystem and Spark.
- Develop scalable data solutions on AWS and Snowflake.
- Automate deployments and manage infrastructure using DevOps practices and containerization.
- Collaborate within an agile scrum environment to deliver data-driven features.

**Required Skills:**
- 5-8 years of experience with Hadoop and big data technologies.
- 3+ years of hands-on experience with Spark.
- Proficiency in Python, PySpark, or Scala.
- Experience with HDFS, MapReduce, Hive, Pig, Impala, Kafka, Kudu, and Solr.
- 1+ years of experience with Snowflake and AWS cloud development.
- Experience with OpenShift, Docker, and Kubernetes.
- Strong DevOps skills including source control, continuous integration, and automated deployments.
- Any Graduate degree.

**Preferred Skills:**
- Relevant industry certifications.
- Experience with Agile (Scrum) development methodologies. As a Data Solutions Developer in our company, your role will involve developing and implementing data solutions using big data technologies and cloud infrastructure.

**Responsibilities:**
- Build and maintain data pipelines using the Hadoop ecosystem and Spark.
- Develop scalable data solutions on AWS and Snowflake.
- Automate deployments and manage infrastructure using DevOps practices and containerization.
- Collaborate within an agile scrum environment to deliver data-driven features.

**Required Skills:**
- 5-8 years of experience with Hadoop and big data technologies.
- 3+ years of hands-on experience with Spark.
- Proficiency in Python, PySpark, or Scala.
- Experience with HDFS, MapReduce, Hive, Pig, Impala, Kafka, Kudu, and Solr.
- 1+ years of experience with Snowflake and AWS cloud development.
- Experience with OpenShift, Docker, and Kubernetes.
- Strong DevOps skills including source control, continuous integration, and automated deployments.
- Any Graduate degree.

**Preferred Skills:**
- Relevant industry certifications.
- Experience with Agile (Scrum) development methodologies.





Source link