Expertise in Spark ecosystems, Data frame API, Data set API, RDD APIs & Spark SQL.
Expertise in workspace and cluster configuration, performance tuning and log
Good understanding on security of spark clusters, network connectivity and IO
Experience with spark streaming jobs integrating with streaming frameworks.
Hands on experience with Python, Scala and SQL.
Integrating Databricks with various ETL tools and perform required operations.
Job Type: Full-time
Salary: $40,000.00 – $75,000.00 per year