LLM Application The purpose of Appcalition is to try our best to meed the demand of users. Depth of technology is not very important. There are many unexplainable points in the field of LLM, as a...

LLM Inference It’s a great milestone when I finish a mature and iterable project, even it’s still in the first stage. There’re plenty AI infra repositoreis and projects in github, but most of the...

This is the first week to work as a LLM inference engineer, the real work content is what I want in the past. I don’t have much experience in this field, But it’s still acceptable. To do what I l...

This is the second time period that I need to seek a job position in my life till now. I don’t have much experience to take a interview in the past, I think I learn a lot this time. First lesson I...

Happy New Year! Feel more happiness this year, really enjoy.

What I do keywods: Jan-May: work Travel: wuhan, huangshan IELTS Products: Chinese blog collection slack to discord IELTS speaking assistant PopTranslate ...

Product Triton Try to debug the Liger-Kernel but found it works well except bfloat type. Learning news about LLM translation and try to realise the whole one in this kind of project, like cut cros...

Product Implementation of Triton I tried to realise better cross entropy loss by Triton, but failed, still trying to find the reason… PopTranslate Update to 3.2, replace self-hosted translation se...

Product Triton-Puzzle This is a project tearch you how to use Triton, which is a new open-source alternative language for cuda. It’s always hard to understand and use it if you are not familiar wit...

Product AutoBuilder Almost spend half of this week on AutoBuider, finish it and use it to build another project, ID_confuser, which programmed totally by AutoBuilder and spend only ten minutes. Su...