First, different rules for different risks. The strongest regulation should be applied to use cases with the greatest risks to people and society. Second, clearly defining risks. There must be clear guidance on AI uses or categories of AI supported activity that are inherently high risk. This common definition is key to enabling a clear understanding of what regulatory requirements will apply in different use cases and contexts. Third, be transparent. So AI shouldn’t be hidden. Consumers should know when they’re interacting with an AI system and that they have recourse to engage with a real person should they so desire. No person anywhere should be tricked into interacting with an AI system. And finally, showing the impact. For higher risk use cases, companies should be required to conduct impact assessments that show how their systems perform against tests for bias and other ways that they could potentially impact the public. And to attest that they’ve done so by following risk-based use case-specific approach.

a precision regulation

a threshold of capabilities

We believe that the benefits of the tools we have deployed so far vastly outweigh the risks,

be My Eyes, used our new multimodal technology in GPT-4 to help visually impaired individuals navigate their environment.

We think it can be a printing press moment.

But the basic question we face is whether or not this issue of AI is a quantitative change in technology or a qualitative change.

We had four bills initially that were considered by this committee and what may be history in the making. We passed all four bills with unanimous roll calls, unanimous roll calls. I can’t remember another time when we’ve done that.

will we strike that balance between technological innovation and our ethical and moral responsibility to humanity, to liberty, to the freedom of this country?

I was reminded of the psychologist and writer Carl Jung, who said at the beginning of the last century that our ability for technological innovation, our capacity for technological revolution, had far outpaced our ethical and moral ability to apply and harness the technology we developed.

is it gonna be more like the atom bomb, huge technological breakthrough, but the consequences severe, terrible, continue to haunt us to this day

Is it gonna be like the printing press that diffused knowledge, power, and learning widely across the landscape that empowered, ordinary, everyday individuals that led to greater flourishing, that led above all two greater liberty?

We should not repeat our past mistakes, for example, Section 230

scorecards and nutrition labels

known risks

transparency

Now we have the obligation to do it on AI before the threats and the risks become real. Sensible safeguards are not in opposition to innovation.

we may need something like CERN, global, international, and neutral, but focused  on AI safety, rather than high-energy physics.  

Chatbots can clandestinely  shape our opinions, in subtle yet potent ways, potentially exceeding what social media can do.  Choices about datasets may have enormous, unseen influence. 

I call datocracy, the opposite of democracy:

These  guardrails should be matched with meaningful steps by the business community  to do their part.

an AI Ethics Board

a lead AI ethics official

on regulatory guardrails

A risk based approach ensures that guardrails for AI apply to any application, even as  this new, potentially unforeseen developments in the technology occur, and that  those responsible for causing harm are held to account.

a “precision regulation” approach to  artificial intelligence. This means establishing rules to govern the deployment of AI  in specific use-cases, not regulating the technology itself. 

international cooperation on AI safety, including examining potential intergovernmental oversight mechanisms and standard-setting. 

safety standards, evaluation requirements, disclosure practices, and external validation mechanisms for AI systems subject to license or registration. 

a combination of licensing or registration requirements

adhere to an appropriate set of safety requirements,

regulation of AI is essential,

to minimize any harmful effects for workers and businesses.

the Alignment Research Center (ARC)

a Cybersecurity Working Group

a Cybersecurity Grant Program

novel security controls to help protect core model intellectual property.

We will continue to explore partnerships with industry and researchers, as well as with governments, that encompass the full disinformation lifecycle. 

takes a whole-of-society approach

we recognize that there is more work to do to educate users about the limitations of AI tools, and to reduce the likelihood of inaccuracy.

Thorn’s Safer37 service

to generate hateful, harassing, violent or adult content, among other categories,

Any ChatGPT user can opt-out of having their conversations be used to improve our models.33 Users can delete their accounts,34 delete specific conversations from the history sidebar, and disable their chat history at any time.35 

via our API

for the purposes of advertising, promoting our services, or selling data to third parties

Iterative deployment

people and our institutions need time to update and adjust to increasingly capable AI, and that everyone who is affected by this technology should have a significant say in how AI develops further.

unsafe content

including but not limited to, generation of violent content, malware, fraudulent activity, high-volume political campaigning, and many other unwelcome areas.

disallowed content

These opportunities are why former U.S. Treasury Secretary Lawrence Summers has said that AI tools such as ChatGPT might be as impactful as the printing press, electricity, or even the wheel or fire.

Microsoft is an important investor in OpenAI, and we value their unique alignment with our values and long-term vision, including their shared commitment to building AI systems and products that are trustworthy and safe.

“What I keep emphasizing to people is to just start using this,” says Mollick. As workers get increasing fluent, he adds, they can find themselves ahead of the curve, and at a distinct advantage in the workplace. Workers resistant to AI could be seen as unwilling or incapable of adapting, says Frey. “I think workers that don't work with AI are going to find their skills [become] obsolete quite rapidly. So, therefore, it's imperative to work with AI to stay employed, stay productive and have up to date skills.”

increasing the demand for jobs including data analysts and scientists who work with the technology to create best practices in the workplace.

might be able to identify a confirmation bias in their work, meaning they look for evidence to support an outcome they already believe exists

functions as a sounding board – a tool to bounce ideas off,

In his own field of academia, for instance, he’s seen it test for counterarguments to a thesis, and write an abstract for research. “You can ask it to generate a tweet to promote your paper,” he adds. “There are tremendous possibilities.” For knowledge workers, this could mean creating an outline for a blog and a social media post to go with it, distil complex topics for a target audience

Stability AI announced StableLM - their Language Models.

Open Assistant - just wow - is an open source Chat AI.

How To Evaluate a Chatbot?

To ensure data quality, we convert the HTML back to markdown and filter out some inappropriate or low-quality samples.

Vicuna is created by fine-tuning a LLaMA base model using approximately 70K user-shared conversations gathered from ShareGPT.com with public APIs.

Inspired by the Meta LLaMA and Stanford Alpaca project, we introduce Vicuna-13B, an open-source chatbot backed by an enhanced dataset and an easy-to-use, scalable infrastructure.

Cerebras (not to be confused with our own Cerebra) trains the GPT-3 architecture using the optimal compute schedule implied by Chinchilla, and the optimal scaling implied by μ-parameterization. This outperforms existing GPT-3 clones by a wide margin, and represents the first confirmed use of μ-parameterization “in the wild”. These models are trained from scratch, meaning the community is no longer dependent on LLaMA.

LoRa and ControlNet (not to mention in- and outpainting), there’s a clear benefit to letting people go wild with your tech.

allowing the model to better understand and use context.

We explore two other obvious sources of basis dependency in a Transformer: Layer normalization, and finite-precision floating-point calculations. We confidently rule these out as being the source of the observed basis-alignment.

Alpaca AI is open source and around the same performance as gpt3. https://github.com/tatsu-lab/stanford_alpaca

Look into Modular, they have an interesting platform for AI development.

GPT 4 cost well over $100 million to train alone, $700k to run per day.

we focus on collecting a small high-quality dataset.

built using significant amounts of human annotation.

Our results suggest that learning from high-quality datasets can mitigate some of the shortcomings of smaller models, maybe even matching the capabilities of large closed-source models in the future.

will the future see increasingly more consolidation around a handful of closed-source models, or the growth of open models with smaller architectures that approach the performance of their larger but closed-source cousins?

This suggests that in the future, highly capable LLMs will be largely controlled by a small number of organizations, and both users and researchers will pay to interact with these models without direct access to modify and improve them on their own.

the community should put more effort into curating high-quality datasets

it suggests that models that are small enough to be run locally can capture much of the performance of their larger cousins if trained on carefully sourced data

large closed-source models to smaller public models

Google "We Have No Moat, And Neither Does OpenAI"

Open source alternatives can and will eventually eclipse them unless they change their stance. In this respect, at least, we can make the first move.

This necessarily means relinquishing some control over our models. But this compromise is inevitable. We cannot hope to both drive innovation and control it.

But this control is a fiction. Anyone seeking to use LLMs for unsanctioned purposes can simply take their pick of the freely available models.

By owning the platform where innovation happens, Google cements itself as a thought leader and direction-setter, earning the ability to shape the narrative on ideas that are larger than itself.

These models are used and created by people who are deeply immersed in their particular subgenre, lending a depth of knowledge and empathy we cannot hope to match.

But holding on to a competitive advantage in technology becomes even harder now that cutting edge research in LLMs is affordable.

he best are already largely indistinguishable from ChatGPT.

This means that as new and better datasets and tasks become available, the model can be cheaply kept up to date, without ever having to pay the cost of a full run.

Being able to personalize a language model in a few hours on consumer hardware is a big deal, particularly for aspirations that involve incorporating new and diverse knowledge in near real-time.

called low rank adaptation, or LoRA

The barrier to entry for training and experimentation has dropped from the total output of a major research organization to one person, an evening, and a beefy laptop.

Giant models are slowing us down.

Open-source models are faster, more customizable, more private, and pound-for-pound more capable.

Scalable Personal AI: You can finetune a personalized AI on your laptop in an evening.

he world and preparing for change rather than trying to roll history back

The author, Ganesh Sitaraman, calls for an American “grand strategy of resilience.”(link is external)  

it will be the American responsibility to listen more and collaborate more seriously to ensure broadly supported recommendations. 

its resilience and adaptability.

If we had looked forward decades ago to understand and accept what was going to be happening today in front of our eyes, we would have had time to better manage the adjustment and implement the remedies.

“Tragedy and Mobilization”, the world confronts the cumulative effects of unmanaged climate change. 

In “Separate Silos” the world fails to manage a co-existence model and the global order devolves into regional power blocs - the U.S, the European Union, Japan, Korea, Australia, Russia, China, India and some rising states - focused on self-sufficiency. 

The “Competitive Coexistence” scenario is less dangerous primarily because both the U.S. and China make economic growth a priority and to some extent achieve co-dependency on maintaining a stable global order.

“A World Adrift” scenario, the international system breaks down as the rules and institutions of today’s structures are little used by the major powers, regional states and non-state actors.

The scale of transnational challenges, and the emerging implications of fragmentation, are exceeding the capacity(link is external) of existing systems and structures . . .”

Go global.

Bring in more participants from outside the government in working group formats - private enterprise, institutions, and other stakeholders to start discussions earlier than they might otherwise and to speed up the policy formation process.

Re-establish the diplomacy and science career track at the State Department

Tighten the bond between science and diplomacy. 

the research and policy dimension within the U.S. government five to ten years ahead.

Now soft power has a new role to play, not merely as a cultural tool, but as a science and technology avenue of influence.

the ability to guide outcomes with culture, the sciences and by the power of our example – has receded. 

Overemphasis on the  bilateral model of American diplomacy does not provide the best process for dealing with modern large scale over-the-horizon issues.

new ideas are often confronted by old thinking, passive resistance and a wait-it-out state of mind.

has established a policy ideas channel to inspire new views from within and outside the State Department to challenge “groupthink(link is external)

“Bringing America’s Multilateral Diplomacy into the 21st Century(link is external)”,

The UN is the depository of more than 560 multilateral treaties(link is external)

The Law of the Sea Treaty of 1982

The Outer Space Treaty of 1967

Nuclear and non-nuclear weapons limitation treaties

The Antarctic Treaty of 1959

None is perfect; all treaties have to keep up with the times in order to survive, and all treaties leave some gaps to be solved later. 

The event is a call to action on two fronts: ensuring the safe use of near-Earth orbit and dealing with the dangerous escalation of anti-satellite technology(link is external).

Seeing America pulling back from the world and divided, China announced its plans to replace the United States as the most powerful nation on earth. 

resentment of the middle class.

Young Americans who came of age in the 2000’s have never known a time of peace and tranquility. 

five elements are required: (1) involvement of all the essential stakeholders (those that could make or break an agreement), (2) consensus definition of the problem, (3) sufficient common interests to generate a productive dialogue, (4) a shared commitment by the stakeholders to finding a solution, and (5) successful post-agreement implementation that stands the test of time.

The lack of a genuine partnership between the worlds of science and diplomacy to integrate multidisciplinary subject-matter

Today our diplomats are not trained in the scientific aspects of dealing with issues of global health, climate change, energy renewal, cyber threats, food and water resources, regional or global supply chains and outer space among others.

No global issue of significance today or for the foreseeable future will be solely national - allocating more of the diplomatic circle graph to the multilateral slice is both in our interest and more likely than ever to be the methodology of the future.

to engage with the larger issues looming just over the horizon.

is consumed with managing the moment, the immediate.

by engaging with others at the “early stages” of issues to keep us on the front lines of managing global trends.

one that recognizes the changing nature of the challenges we will inevitably face in the future – not just the problems we face now.

The Luddites were not anti-technology; what they wanted was economic justice.

A.I. researchers are increasing the concentration of wealth to such extreme levels that the only way to avoid societal collapse is for the government to step in.

the only way to make things better is to make things worse.

What Žižek advocated for is an example of an idea in political philosophy known as accelerationism

it seems like a way for the people developing A.I. to pass the buck to the government.

A.I. assists capital at the expense of labor.

by hiring consultants, management can say that they were just following independent, expert advice.

we rely on metaphor,

it triggers a mental shortcut in the minds of users that we call a “machine heuristic.” This shortcut is the belief that machines are accurate, objective, unbiased, infallible and so on.

Copyleft licensing allows for content to be used, reused or modified easily under the terms of a license – for example, open-source software.

But with self-driving cars, the engineers can never be sure how it will perform in novel situations.

that people treat computers as social beings when the machines show even the slightest hint of humanness, such as the use of conversational language.

Such beliefs build on “automation bias” or the tendency to let your guard down when machines are performing a task

However, if not coupled with resources and pressure to actually perform this sector-specific adaptation, this approach runs the risk of resulting in no meaningfully binding regulation at all.

a unique blend of horizontal and vertical elements

sectoral regulators will be outmatched in their efforts to meaningfully constrain businesses applying AI.

If agencies do not coordinate to build common regulatory tools, they risk reinventing the wheel each time a new department is tasked with regulating a specific application of AI.

if industry-dominated standards bodies set weak standards for compliance, the regulation itself becomes weak.

Their legislative bodies will need the ability to amend or add to its main horizontal regulation in order to keep pace with the technology.

the heavy lifting of articulating specific compliance thresholds will be done by Europe’s main standardization bodies

the EU’s broad approach will stifle innovation, and analysts correctly assert that China’s targeted regulations will be used to tighten information controls.

they effectively function to shift power from technology companies to government regulators

such as their sources for training data and potential security risks.

the algorithm registry

disseminating information, as well as setting prices and dispatching workers.

has taken a fundamentally vertical approach: picking specific algorithm applications and writing regulations that address their deployment in certain contexts.

the standards process has historically been driven by industry, and it will be a challenge to ensure governments and the public have a meaningful seat at the table.

Another factor is whether the proposed central and horizontal European AI Office will be effective in supplementing the capacity of national and sectoral regulators.

risk-based approach

the dual imperatives of providing predictability and keeping pace with AI developments.

the requirements in the AI Act with co-regulatory strategies

The easiest way for developers to satisfy these mandates will be for them to adhere to technical standards that are being formulated by European standards-setting bodies.

Applications deemed to pose an “unacceptable risk” (such as social scoring and certain types of biometrics) are banned. “High risk” applications that pose a threat to safety or fundamental rights (think law enforcement or hiring procedures) are subject to certain pre- and post-market requirements. Applications seen as “limited risk” (emotion detection and chatbots, for instance) face only transparency requirements. The majority of AI uses are classified as “minimal risk” and subject only to voluntary measures.

In a horizontal approach, regulators create one comprehensive regulation that covers the many impacts AI can have. In a vertical strategy, policymakers take a bespoke approach, creating different regulations to target different applications or types of AI.

in July last year that about 40% of young people turn to TikTok or Meta Platforms-owned Instagram when searching for restaurants, citing an internal study.

Bing’s share of the search market has remained below 3%

to ask follow-up questions or swipe through visuals such as TikTok videos in response to their queries.

an advertising business that made more than $162 billion in revenue last year.

It plans to incorporate more human voices as part of the shift, supporting content creators in the same way it has historically done with websites, the documents say.

2023:

The hardware, hilariously, became very easy to procure because of the recent crypto mining boom and bust. Several companies offering AI hardware in the cloud were actually crypto mining operations until recently.

The people who are already well versed in something are going to be the ones capable of making the most helpful applications for that particular field or industry.

arent there already LLM models that cite their sources? or I heard that new plugin with chat GPT can cite its sources

The general consensus is that, especially customer facing automation, MUST be "explainable." Meaning whenever a chat bot or autonomous system writes something or makes a decision, we have to know exactly how and why it came to that conclusion.

They are caught up in the hype and just like everyone else have zero clue what's actually going to happen.

Across the global South, the conflict in Ukraine is seen largely as a European affair, one without an obvious hero or villain.

The overwhelming majority, 720 million, lived in Latin America, Africa, and Asia. More than 400 million lived in Latin America alone. By 2025, only one in five Catholics will be a non-Hispanic Caucasian.

the Holy See has practiced what academics call the “great power” model of diplomacy, attaching itself to the superpower of the day.

More Catholics than ever before live outside the West and don’t see the war in Ukraine on the same terms as Europe and the United States do.

the Stanford Politeness Dataset,

ensuring the LLM produces reliable outputs for a particular business use-case often requires additional training on actual data from this domain labeled with the desired outputs.

a fine-tuned Large Language Model (LLM; a.k.a. Foundation Model).

Only half say their organizations are well prepared to anticipate and react to external shocks, and two-thirds see their organizations as overly complex and inefficient.

to shore up resilience

Open source alternatives can and will eventually eclipse them unless they change their stance. In this respect, at least, we can make the first move.

Research institutions all over the world are building on each other’s work, exploring the solution space in a breadth-first way that far outstrips our own capacity. We can try to hold tightly to our secrets while outside innovation dilutes their value, or we can try to learn from each other.

Part of what makes LoRA so effective is that—like other forms of fine-tuning—it’s stackable. Improvements like instruction tuning can be applied and then leveraged as other contributors add on dialogue, or reasoning, or tool use. While the individual fine tunings are low rank, their sum need not be, allowing full-rank updates to the model to accumulate over time.

calling this the "Stable Diffusion moment" for LLMs.

their efforts are rapidly being eclipsed by the work happening in the open source community.

Yuval Noah Harari

The Vedic principles have influenced the Indian psyche for many centuries. These principles have underpinned the socio-cultural-religious framework for the development of individual and social moral principles. The Indian psyche and society is in a phase of rapid evolution. Pursuit of Artha and Kama are overtaking the responsibility of Dharma.

Dharma embraces every type of righteous conduct, covering every aspect of life, both religious and secular, that is essential for the sustenance and welfare of the individual, society and creation.

Ontological nature of existence and Dharma (which approximately translates into morality).

These teachings comprehensively bring out the essence of Vedas, primarily Upanishads, in a language that is less terse than that in the original Upanishads

It is then that Lord Krishna enlightens him through the teachings that together form the Bhagavad Gita.

It forms a part of the great epic, Mahabharata which is traditionally ascribed to the sage Vyasa.

The Bhagavad Gita

set of dialogues

Upanishads are passages from the Jnana-kanda section of the Vedas. They are the core of Vedic wisdom and are essentially philosophical in nature