In this paper, we propose an E-voting system based on and improved from our previous work (Name and vOte separaTed E-voting system, NOTE). The proposed E-voting system, referred to as Enhanced NOTE (E-NOTE), is enhanced with a new protocol design and watchdog hardware device to ensure voter confidentiality and voting accuracy. In our improved scheme, other than the Election Committee (EC) and Vote Counting Committee (VCC), an impartial third party, Ballot Distribution Center (BDC), is proposed to take the responsibility of distributing ballots. The votes and the candidates' names are separated into two parts when the voters cast their votes. The watchdog device records all voting transactions to prevent voter frauds. Our proposed procedure addresses issues related to voter confidentiality, voter frauds, and voting accuracy, thus providing a framework for fair elections.