In his memoir Work Hard, Study … And Keep Out of Politics!, Baker recalls his early years with his strict father, who sometimes splashed cold water on James if he didn’t wake up. Though his dad was a disciplinarian, they were close, and Baker calls him a "terrific dad." James also credits his father for teaching him patience through the sport of hunting. His father also made James play tennis, which proved fateful for the young man.
An active and popular Houston lawyer, Baker made several political connections during tennis games. Like most Texans, James Baker started off as a Democrat, but he chose to switch parties to help a friend work on his senatorial campaign. Baker says he mostly got into politics to get his mind off his wife’s death. It was during tennis that he met George H.W. Bush, as both men shared a passion for the game. Their friendship extended off the court, and Baker helped Bush through his political career, eventually serving as the Secretary of State.
In his memoirs, Baker gives an insider’s look into Republican presidencies. He focuses on the Republican feud between old-money power brokers and right-wing ideologues. Through it all, James Baker defends and explains his pragmatic approach to conservative politics as a balancing act between these two camps. Baker has often been harshly criticized by his moderate approach to politics, but Baker shows in his memoirs that striking a balance is crucial to successful politicking.