E
Full Time Any

Job detail

Lead, Big Data Administrator

Epsilon Data Management LLC

Irving, Texas, United States

Job description

Telecommuting available from anywhere in the US Requirements Employer will accept a bachelors degree in Computer Applications or a related field followed by eight years of progressive, post-baccalaureate experience in the job offered or eight years of progressive, post-baccalaureate experience in any occupation in which the required experience was gained Position requires: 1. Proficiency with the core Hadoop components and managing a cluster, including HDFS, Yarn, Hive, and Spark, as well as Kafka clusters. 2. Utilize ZooKeeper for coordination and synchronization within both Hadoop and Kafka clusters 3. Kerberos Security-Authentication: Kerberos, LDAP integration; Encryption: SSL/TLS, Hadoop KMS; Audit Tools: Ranger, Atlas, or custom solutions 4. Prometheus and Grafana to visualize metrics and set up alerts to track the health, performance, and resource utilization of clusters. 5. Diagnose and resolve complex issues related to cluster connectivity, performance degradation, and system failures 6. Fine-tune cluster configurations and optimize job performance by adjusting parameters related to memory, I/O, and replication 7. Bash and Python to automate routine tasks such as backups, log management, and cluster maintenance Telecommuting available from anywhere in the US Contact: in order to be considered for this position, please Must reference job: 6630.7112.9

Need help finding a job?

Chat with our AI assistant.