Preheat the oven to 400 degrees. Spray a 9 x 13 pan with cooking spray.
In a large bowl combine the oil, oregano, parsley, dill, paprika, sea salt, and pepper. Add in the potatoes and toss to coat. Spread out in the baking pan and bake for 30 minutes, stirring once in the middle of baking.
Meanwhile, combine the feta, lemon juice, oregano, and parsley in a bowl and set aside.
Remove the potatoes from the oven, toss with the marinated feta, and bake for an additional 5 minutes. Serve immediately.