Joe was born on April 6, 1950 in Dalhart to Johnny and Jane Willey. He was raised in Stratford, where he graduated from Stratford High School. Upon graduation, he enlisted in the United States Army, where he was stationed in Ethiopia during the Vietnam War. He served at the Walter Reed Hospital, where he made artificial limbs and braces. Upon his discharge, he attended Panhandle State University, where he received his Bachelors of Science in 1987 before attending Wayland Baptist University, where he received his Master's Degree of Science in 1992. He attended several other universities, as he was passionate about education and his greatest enjoyments were learning and teaching others.

Joe simultaneously ran his own business, a boot and saddle shop, drove a school bus, helped to run the family farm, and raised his 4 children with their mother while obtaining his Bachelor and Master's Degree in 5 years' time. He taught in McClave, CO, Plainview, Floydada, Tulia and eventually retired from Haltom High School. Upon retirement, he worked at the Ranger's stadium and was an avid fan and attended as many games as possible as well as toured many stadiums all over the U.S.

He was a storm chaser and introduced his children and grandchildren to his passion about weather. When people say they spoke with him about the weather, they were speaking of a detailed, interesting, in-depth conversation, as it was not just small talk for him. Joe was giving and generous to others. He bicycled for the Diabetes foundation, donated blood as often as he could, and volunteered at the V.A., always giving compassion, friendship and respect to his fellow veterans. He was also an organ donor following his death. He received the Michael Jordan grant, using it to educate students about agriculture in the Texas Panhandle.

Joe is survived by 2 daughters, Christie Willey Chadwick and husband Billy and their children, Cali and Cy and Katherine Willey Nusz and husband, Daniel and their son, Matthew; 2 sons, Travis Willey and wife Lindie and their children, Wesley and Tyler and Joshua Willey and wife Amber and 3 sisters, Judy Willey Williams, Janetta Willey Britten and Janice Willey Brown.

He was preceded in death by his parents and brother, Wesley Willey.