The rights groups warn travellers about what they say is the potential for denial of entry to the country and risk of arrest, travel restrictions on citizens from dozens of countries, social media screening, racial profiling, and increased surveillance.
There are travel bans on nationals from four of the countries taking part in the tournament: Iran, Haiti, Senegal and Ivory Coast.
The groups say travellers should take steps including removing sensitive information from phones and keeping friends and family updated about their plans when travelling.
The United States is co-hosting the tournament alongside Canada and Mexico, with 78 of the 104 scheduled matches at the tournament taking place in the US.
The signatories are critical of Fifa, accusing it of failing to issue “concrete guarantees” on safety for travellers “while its president, Gianni Infantino, has aligned himself closer to the Trump administration”.
In December, Infantino awarded President Trump with Fifa’s inaugural Peace Prize.
An immigration crackdown has been a key focus of the Trump administration, with Immigration and Customs Enforcement (ICE) having its scope and budget significantly expanded.
ICE has faced criticism for its methods – especially following the fatal shooting of two US citizens who were protesting against the immigration crackdown.
US officials have said ICE agents will be part of World Cup security. Earlier this year, fan group Football Supporters Europe (FSE) told BBC Sport it was “extremely concerned by the ongoing militarisation of police forces in the US”.
Last month, a report from human rights campaign group Amnesty said the World Cup risked becoming “a stage for repression and a platform for authoritarian practices”.
In response to that, the White House’s World Cup Task Force said that the tournament will be “the largest, safest, and most welcoming sporting event in history” and that it was working to deliver an event “that highlights America’s hospitality, commitment to security, and spirit of excellence”.
It promised that fans “can look forward to a smooth, secure, and truly unforgettable tournament”.