This paper develops formulas for pricing caps and swaptions in LIBOR market models with jumps. The arbitrage-free dynamics of this class of models were characterized in Glasserman and Kou (1999) in a framework allowing for very general jump processes. For computational purposes, it is convenient to model jump times as Poisson processes; however, the Poisson property is not preserved under the changes of measure commonly used to derive prices in the LIBOR market model framework. In particular, jumps cannot be Poisson under both a forward measure and the spot measure, and this complicates pricing. To develop pricing formulas, we approximate the dynamics of a forward rate or swap rate using a scalar jump-diffusion process with time-varying parameters. We develop an exact formula for the price of an option on this jump-diffusion through explicit inversion of a Fourier transform. We then use this formula to price caps and swaptions by choosing the parameters of the scalar diffusion to approximate the arbitrage-free dynamics of the underlying forward or swap rate. We apply this method to two classes of models: one in which the jumps in all forward rates are Poisson under the spot measure, and one in which the jumps in each forward rate are Poisson under its associated forward measure. Numerical examples demonstrate the accuracy of the approximations.