Hacker Newsnew | past | comments | ask | show | jobs | submit | catchmrbharath's commentslogin

The APK that you linked, runs the inference on CPU and does not run it on Google Tensor.


That sounds fair, but opens up another N questions:

- Are there APK(s) that run on Tensor?

- Is it possible to run on Tensor if you're not Google?

- Is there anything at all from anyone I can download that'll run it on Tensor?

- If there isn't, why not? (i.e. this isn't the first on device model release by any stretch, so I can't give benefit of the doubt at this point)


> Are there APK(s) that run on Tensor?

No. AiCore service internally uses the inference on Tensor (http://go/android-dev/ai/gemini-nano)

> Is there anything at all from anyone I can download that'll run it on Tensor?

No.

> If there isn't, why not? (i.e. this isn't the first on device model release by any stretch, so I can't give benefit of the doubt at this point)

Mostly because 3P support has not been a engineering priority.


> Mostly because 3P support has not been a engineering priority.

Got it: assuming you're at Google, in eng. parlance, it's okay if it's not Prioritized™ but then product/marketing/whoever shouldn't be publishing posts around the premise it's running 60 fps multimodal experiences on device.

They're very, very, lucky that ratio of people vaguely interested in this, to people follow through on using it, is high, so comments like mine end up at -1.


Tensor is essentially shipping subpar hardware with not even taking care of software properly.

https://ai.google.dev/edge/litert/android/npu/overview has been identical for a year+ now.

In practice Qualcomm and MediaTek ship working NPU SDKs for third party developers, NNAPI doesn't count and is deprecated anyway.


Man this is a funny situation. Ty for sharing, more or less confirms my understanding. Couldn't quite believe it when I was in Google, or out of Google. This should be a big scandal afaict. What is going on???

(n.b. to readers, if you click through, the Google Pixel Tensor API is coming soon. So why in the world has Google been selling Tensor chips in Pixel as some big AI play since...idk, at least 2019?)


Yes, you can use first-party models on the Pixel NPUs or you're stuck with NNAPI which is self-admittedly deprecated by Google and doesn't work all that well.

On third party model workloads, this is what you will get:

https://ai-benchmark.com/ranking.html

https://browser.geekbench.com/ai-benchmarks (NPU tab, sort w/ quantisation and/or half precision)

Google is clearly not serious on Pixels in practice, and the GPU performance is also behind by quite a lot compared to flagships, which really doesn't help. CPUs are also behind by quite a lot too...


How does their demo work then? It's been 3 months since 3n was first released publicly.


What demo?

The only one we have works as described, TL;Dr 0.1 fps.


Google’s Grammar checker works completely offline.[1]

[1]https://ai.googleblog.com/2021/10/grammar-correction-as-you-...

(Disclosure: I work at Google)


Thanks for the pointer. This is an impressive job - reducing a grammar correcting model to as much as 20MB. Theoretically this could even be shipped to browsers and if we are able to wrap it in an extension that works everywhere, this could seriously compete with Grammarly.

I could understand why Google wouldn't open-source this tech, but the blog pretty much covers how to build one. I'm surprised there isn't any open source project that took this direction to bring a privacy-focused grammar checker.


Small Nitpick: You cannot reconstruct a square wave even if you use infinite fourier coefficients due to Gibbs phenomenon.(https://en.m.wikipedia.org/wiki/Gibbs_phenomenon)


Your link seems to contradict you?

> Informally, the Gibbs phenomenon reflects the difficulty inherent in approximating a discontinuous function by a finite series of continuous sine and cosine waves. It is important to put emphasis on the word finite because even though every partial sum of the Fourier series overshoots the function it is approximating, the limit of the partial sums does not. The value of x where the maximum overshoot is achieved moves closer and closer to the discontinuity as the number of terms summed increases so, again informally, once the overshoot has passed by a particular x, convergence at that value of x is possible.

> There is no contradiction in the overshoot converging to a non-zero amount, but the limit of the partial sums having no overshoot, because the location of that overshoot moves. We have pointwise convergence, but not uniform convergence. For a piecewise C1 function the Fourier series converges to the function at every point except at the jump discontinuities. At the jump discontinuities themselves the limit will converge to the average of the values of the function on either side of the jump. This is a consequence of the Dirichlet theorem.[11]


the second paragraph spells it out? at the jump the series converges to the average rather than either value.


Meta nitpick: the Gibbs phenomenon is a statement about any arbitrary finite decomposition. The limit of the wave form as the number of terms goes to infinity is in fact exactly a square wave.


As usual, infinity complicates things; the series has pointwise convergence but not uniform convergence in such cases.


Doesn’t it still converge in the L2 norm? (The L2 distance between two functions is the area trapped between them).


sure you can, up to a negligible set


The whole world knows it as Arabic numerals. I am not contesting where it originated, I am just saying, that using Indian numerals confuses everyone.


It's Hindu-Arabic numerals to be precise: https://en.wikipedia.org/wiki/Hindu%E2%80%93Arabic_numeral_s...


So you can use this as an opportunity to educate everyone.


Hinduism and the Hindi language are two different things, and they are not related.


Hindu nationalism has historically been quite related to pushing of the Hindi language, however.

(generally there always has been a push for the Hindi language from the central government as well)


Wasn't sure where to comment. So I will comment here. Which north Indian state do you think Hindi is the native language of?


That's a non sequitur. It doesn't have to be a native language for folks to push it; it can be close.


Folks push it because it's Indian and understood by most. Folks resist and protest because it's not their native language and somehow worse than having English everywhere.


> Folks push it because it's Indian and understood by most.

I don't ... dispute that? You're continuing with the non sequiturs and it's really hard to tell what point you're trying to make.

("most" is also "bit more than half the population", which isn't that compelling)

> Folks resist and protest because it's not their native language and somehow worse than having English everywhere.

You have not understood the resistance. People don't think it's "somehow worse than having English everywhere". There is no analogous push for English everywhere that people are not opposing.


I am sorry. This is not in response to your particular comment. Was just trying to have a conversation.



Looks like its not maintained.


> Lights candles to summon Jason Scott to ingest it into the Internet Archive

And he has responded. https://lars.ingebrigtsen.no/2016/07/28/the-end-of-gmane/com...


India has about 18 official languages. Its hard to support all the official languages.

Also, the people who are online are mostly people who understand English. Supporting languages does not increase their outreach.


I used to believe this. As a masters student who is going to graduate soon, I have to put in months of preparation for the interviews. Nobody believes in your ability to write code even after having close to 100+ commits to a popular open source project. People expect you to come to the correct solution after 5 minutes of them asking the question.


IME the interview you have depends a lot on org size and how close the interviewer is to the money. A technical founder will tend to interview with an eye towards product and marketing and sitting down in a real environment to do sample code. As you go down the line and interview at bigger orgs with more departments, it becomes more specialized, the culture overwhelms the business, and you get more of the "idealized CS graduate" syndrome.


Meh, I never prepared for any interviews and I'm gainfully employed. Granted, I don't apply to companies who are known to give whiteboard challenges I have to prep for.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: