The Business Times

Tech workers take a stand against projects they disapprove of

They are now more aware of social costs and want to know if the products are used for unethical purposes

Published Mon, Oct 8, 2018 · 09:50 PM

San Francisco

JACK Poulson, a Google research scientist, recently became alarmed by reports that the company was developing a search engine for China that would censor content on behalf of the government.

While Mr Poulson works on search technologies, he had no knowledge of the product, which was code-named Dragonfly. So in a meeting last month with Jeff Dean, the company's head of artificial intelligence, Mr Poulson asked if Google planned to move ahead with the product and if his work would contribute to censorship and surveillance in China.

According to Mr Poulson, Mr Dean said Google complied with surveillance requests from the federal government and asked rhetorically if the company should leave the US market in protest. Mr Dean also shared a draft of a company e-mail that read: "We won't and shouldn't provide 100 per cent transparency to every Googler, to respect our commitments to customer confidentiality and giving our product teams the freedom to innovate."

The next day, Mr Poulson quit the company. Mr Dean did not respond to a request for comment, and Google declined to comment.

Across the technology industry, rank-and-file employees are demanding greater insight into how their companies are deploying the technology that they build. At Google, Amazon, Microsoft and Salesforce, as well as at tech startups, engineers and technologists are increasingly asking whether the products they are working on are being used for surveillance in places such as China or for military projects in the US or elsewhere.

That is a change from the past, when Silicon Valley workers typically developed products with little questioning about the social costs. It is also a sign of how some tech companies, which grew by serving consumers and businesses, are expanding more into government work. And the shift coincides with concerns in Silicon Valley about the Trump administration's policies and the larger role of technology in government.

"You can think you're building technology for one purpose, and then you find out it's really twisted," said Laura Nolan, 38, a senior software engineer who resigned from Google in June over the company's involvement in Project Maven, an effort to build artificial intelligence for the Defense Department that could be used to target drone strikes.

All of this has led to growing tensions between tech employees and managers. In recent months, workers at Google, Microsoft and Amazon have signed petitions and protested to executives over how some of the technology they helped create is being used. At smaller companies, engineers have begun asking more questions about ethics.

And the change is likely to last: Some engineering students have said they are demanding more answers and are asking similar questions, even before they move into the workforce.

The difficulties of knowing what companies are doing with technologies is compounded because engineers at large tech companies often build infrastructure - such as algorithms, databases and even hardware - that underpins almost every product a company offers. At Google, for example, a storage system called Colossus is used by Google search, Google Maps and Gmail.

"It would be very difficult for most engineers in Google to be sure that their work wouldn't contribute to these projects in some way," said Ms Nolan, who helped to keep Google's systems running online smoothly. "My personal feeling was that if the organisation is doing something I find ethically unacceptable, then I was contributing to it."

Yet executives at tech companies have claimed that complete transparency is not possible. "We've always had confidential projects as a company. I think what happened when the company was smaller, you had a higher chance of knowing about it," Sundar Pichai, Google's chief executive, said at a staff meeting in August, according to a transcript provided to The New York Times. "I think there are a lot of times when people are in exploratory stages where teams are debating and doing things, so sometimes being fully transparent at that stage can cause issues."

Such policies have rippled beyond tech companies. In June, more than 100 students at Stanford, MIT and other top colleges signed a pledge saying they would turn down job interviews with Google unless the company dropped its Project Maven contract. (Google said that month that it would not renew the contract once it expired.) "We are students opposed to the weaponisation of technology by companies like Google and Microsoft," the pledge stated. "Our dream is to be a positive force in the world. We refuse to be complicit in this gross misuse of power."

Alex Ahmed, a doctoral candidate in computer science at Northeastern University in Boston, said she organised a student discussion on campus this month to debate whether they should work for tech companies that made decisions they believed to be unethical.

"We're not given an ethics course. We're not given a political education," Ms Ahmed, 29, said. "It's impossible for us to do this unless we create the conversations for ourselves." NYTIMES

BT is now on Telegram!

For daily updates on weekdays and specially selected content for the weekend. Subscribe to  t.me/BizTimes

Technology

SUPPORT SOUTH-EAST ASIA'S LEADING FINANCIAL DAILY

Get the latest coverage and full access to all BT premium content.

SUBSCRIBE NOW

Browse corporate subscription here