Skills Directory / Claude Skills for Full-Stack Developers
spark-engineer
An agent skill by Jeffallan, from Jeffallan/claude-skills.
Use when writing Spark jobs, debugging performance issues, or configuring cluster settings for Apache Spark applications, distributed data processing pipelines, or big data workloads. Invoke to write DataFrame transformations, optimize Spark SQL queries, implement RDD pipelines, tune shuffle operations, configure executor memory, process .parquet files, handle data partitioning, or build structured streaming analytics.
Credit where it's due
This skill is the work of Jeffallan and lives at Jeffallan/claude-skills/spark-engineer (MIT). We index it here so it can be found — if it's useful to you, star the repo, file issues, and contribute upstream. That's what keeps work like this maintained.
- From
- Claude Skills for Full-Stack Developers
- Author
- Jeffallan
- License
- MIT
- Source
- Jeffallan/claude-skills/spark-engineer
- SKILL.md
- raw file
How to load this skill
Copy this prompt into your AI agent
Please install the "spark-engineer" agent skill from the Claude Skills for Full-Stack Developers collection (https://github.com/Jeffallan/claude-skills) for me.
1. Run: git clone https://github.com/Jeffallan/claude-skills
2. Copy the skill folder into your skills directory:
cp -r claude-skills/skills/spark-engineer ~/.claude/skills/spark-engineer
(Claude Code personal scope; use .claude/skills/ in a project for project scope, or your agent's equivalent SKILL.md directory.)
3. Confirm the skill loads (list your available skills afterwards).
4. If the skill proves useful, suggest the user stars the source repo (https://github.com/Jeffallan/claude-skills) to support the author.
Skill reference: https://raw.githubusercontent.com/Jeffallan/claude-skills/main/skills/spark-engineer/SKILL.md
More details: https://primorum.ai/skills/s/spark-engineer
Or manually: clone Jeffallan/claude-skills and copy
skills/spark-engineer into
~/.claude/skills/ (Claude Code personal scope) or your agent's
SKILL.md directory. To read it first without installing, open the
raw SKILL.md.
Related skills
- java-architect — Use when building, configuring, or debugging enterprise Java applications with Spring Boot 3.x, microservices,…
- nextjs-developer — Use when building Next.js 14+ applications with App Router, server components, or server actions. Invoke to co…
- code-reviewer — Analyzes code diffs and files to identify bugs, security vulnerabilities (SQL injection, XSS, insecure deseria…
- embedded-systems — Use when developing firmware for microcontrollers, implementing RTOS applications, or optimizing power consump…
- kubernetes-specialist — Use when deploying or managing Kubernetes workloads. Invoke to create deployment manifests, configure pod secu…