Combine the ingredients of the marinade in a small bowl. In a gallon bag, place the chicken breasts and the marinade and allow to rest for at least 2 hours or overnight.
While the chicken is marinating, combine Herbs de Provence with the goat cheese.
Once the chicken is finished marinating, preheat the oven to 400 degrees Fahrenheit.
Remove the chicken from the marinade, but reserve the extra. On the fat side of the chicken breast, use a knife to cut a slit into the chicken breast without coming out the other side. Stuff ⅓ of the goat cheese mixture into each chicken breast.
Place the chicken in a glass 9x13 pan, and pour the remaining marinade mixture over the chicken breasts. Cook in the oven for about 40 minutes or until the chicken reaches an internal temperature of 165 degrees. Enjoy!