Definition of "Mistakenly" :

adverb: in a mistaken or erroneous manner

"He mistakenly believed it."