Fill a large pot with lightly salted water and bring to a rolling boil over high heat. Once the water is boiling, stir in the penne, and return to a boil. Cook the pasta uncovered, stirring occasionally, until the pasta has cooked through, but is still firm to the bite, about 11 minutes. Rinse with cold water and drain well in a colander set in the sink.
Whisk together the vinegar, lemon juice, garlic, oregano, salt, pepper, and olive oil. Set aside. Combine pasta, tomatoes, onion, green and red capsicums, cucumber, olives, and feta cheese in a large bowl. Pour vinaigrette over the pasta and mix together. Cover and chill for 3 hours before serving.