Albertine and Alberta are old-fashioned feminizations ala Geraldine and Roberta. This is the kind of name that sounds very dowdy until a hip celebrity chooses it, at which point we don't know how we missed its coolness all this time.

Albertine

Amarys

Abastien

Abderie

Abes

Abester

Abian

Abiather

Aderemi

Adoram

Adren

Adric

Aeden

Aethea

Airen

Alberick

Aldren

Aleron

Aliver

Almerin

Alver

Alvery

Amost

Andreo

Anjulie

Arloa

Armenia

Artinian

Aveley

Aylward

Aytoun

Bartholomy

Bayloste

Bealdric

Benami

Builleaume

A variant of Caelan, from a Gaelic name meaning "slender".

Calian

Casmer

Chal

Dillaway

Dolphis

Domicelli

Donalda

Dorson

Eadric

Edmore

Edorgo

Edridge

Edvardus

Elphick

Emele

Emond

Essias

Fiske

Flanie

Franciska

Harlowe

Hermeline

Ivay

Izme

Jarvix

Jibben

The name Lórien appears several times in Tolkien’s novels. It’s both a place name and a character name, and although the name may sound feminine due to the similarity with Lauren and Marien, Tolkein's character Lórien (Master of Visions and Dreams, also called Irmo) is male and the softness of the name will appeal to parents weary of macho names. 

Lorien

Lochie

Lony

Maleine

Maranetta

Maryjana

Medard

Nazeera

Nazzarina

Oelen

Olah

Orine

Parthenia may be a bit unwieldy, but does conjure up majestic images of the Parthenon. 

Parthenia

Reida

Rosina

Simond

A name some people first encountered in the old children's book series The Five Little Peppers, in which Sophronia, the youngest of the Peppers is nicknamed Phronsie.`It was also used by Dickens in two of his novels: The Old Curiosity Shop and Our Mutual Friend.
 An archaic option for elaborating on Sophie/Sophia.

Sophronia

Setrak

Shipman

Solomay

Starah

Taivo

Terzo

Thomaila

Whitfield

Wilton

RenG's list "Rare Forgotten Victorian and Medieval Names" of 92 great name ideas: Albertine - Wilton!

Rare Forgotten Victorian and Medieval Names

All of these names are verified rare Victorian and Medieval names by Ancestry.com. The year search for these names is roughly around 1500-1870. They were once fairly commonly used names that are now mostly forgotten to time.