You just can’t walk up to people with brown skin and say give me your papers,’ a federal judge told Border Patrol attorneys at a hearing challenging recent immigration sweeps.