In Denmark, baptism and name certificates are issued by the local parish office or the parish priest responsible for the church register. This applies whether you were baptized or named without baptism. Find contact details and addresses at https://sogn.dk/
You must be able to verify your identity to the parish office or the parish priest responsible for the church register. However, if you were born in Southern Jutland, requests for a birth and name certificate are handled by the municipality where your birth is registered. The parish office will send the certificate to the embassy, where you can collect it upon presenting valid identification. You can view the embassy’s fee for issuing personal certificates here: The Ministry of Foreign Affairs list of fees.
Read more about ordering certificates at borger.dk
If you are residing abroad temporarily, you must apply for a change of name with the parish or municipality in Denmark where you last resided. If you were born in Southern Jutland, you must apply with the municipality where your birth is registered.
If you have permanent residence and a lasting connection to Iceland, you must apply for a change of name with the Icelandic authorities, even if you are a Danish citizen. If the authorities decline to process your name change due to your Danish citizenship, you must apply with the parish or municipality in Denmark where you last resided (or the municipality of birth registration if born in Southern Jutland). In this case, you must enclose a statement from the authorities in your country of residence certifying that they cannot process your name change due to your citizenship.
If you are a Danish citizen with a Danish CPR number, you must also remember to notify the Danish authorities of your name change abroad. You must contact the municipality in Denmark where you last resided and provide them with official documentation from the Icelandic authorities confirming your change of name.
Read more about name changes at borger.dk.