large closed-source models to smaller public models

Open source alternatives can and will eventually eclipse them unless they change their stance. In this respect, at least, we can make the first move.

This necessarily means relinquishing some control over our models. But this compromise is inevitable. We cannot hope to both drive innovation and control it.

But this control is a fiction. Anyone seeking to use LLMs for unsanctioned purposes can simply take their pick of the freely available models.

By owning the platform where innovation happens, Google cements itself as a thought leader and direction-setter, earning the ability to shape the narrative on ideas that are larger than itself.

These models are used and created by people who are deeply immersed in their particular subgenre, lending a depth of knowledge and empathy we cannot hope to match.

But holding on to a competitive advantage in technology becomes even harder now that cutting edge research in LLMs is affordable.

he best are already largely indistinguishable from ChatGPT.

This means that as new and better datasets and tasks become available, the model can be cheaply kept up to date, without ever having to pay the cost of a full run.

Being able to personalize a language model in a few hours on consumer hardware is a big deal, particularly for aspirations that involve incorporating new and diverse knowledge in near real-time.

called low rank adaptation, or LoRA

The barrier to entry for training and experimentation has dropped from the total output of a major research organization to one person, an evening, and a beefy laptop.

Giant models are slowing us down.

Open-source models are faster, more customizable, more private, and pound-for-pound more capable.

Scalable Personal AI: You can finetune a personalized AI on your laptop in an evening.

Augmenting the human body and mind

he world and preparing for change rather than trying to roll history back

The author, Ganesh Sitaraman, calls for an American “grand strategy of resilience.”(link is external)  

it will be the American responsibility to listen more and collaborate more seriously to ensure broadly supported recommendations. 

its resilience and adaptability.

If we had looked forward decades ago to understand and accept what was going to be happening today in front of our eyes, we would have had time to better manage the adjustment and implement the remedies.

“Tragedy and Mobilization”, the world confronts the cumulative effects of unmanaged climate change. 

In “Separate Silos” the world fails to manage a co-existence model and the global order devolves into regional power blocs - the U.S, the European Union, Japan, Korea, Australia, Russia, China, India and some rising states - focused on self-sufficiency. 

The “Competitive Coexistence” scenario is less dangerous primarily because both the U.S. and China make economic growth a priority and to some extent achieve co-dependency on maintaining a stable global order.

“A World Adrift” scenario, the international system breaks down as the rules and institutions of today’s structures are little used by the major powers, regional states and non-state actors.

The scale of transnational challenges, and the emerging implications of fragmentation, are exceeding the capacity(link is external) of existing systems and structures . . .”

Go global.

Bring in more participants from outside the government in working group formats - private enterprise, institutions, and other stakeholders to start discussions earlier than they might otherwise and to speed up the policy formation process.

Re-establish the diplomacy and science career track at the State Department

Tighten the bond between science and diplomacy. 

the research and policy dimension within the U.S. government five to ten years ahead.

Now soft power has a new role to play, not merely as a cultural tool, but as a science and technology avenue of influence.

the ability to guide outcomes with culture, the sciences and by the power of our example – has receded. 

Overemphasis on the  bilateral model of American diplomacy does not provide the best process for dealing with modern large scale over-the-horizon issues.

new ideas are often confronted by old thinking, passive resistance and a wait-it-out state of mind.

has established a policy ideas channel to inspire new views from within and outside the State Department to challenge “groupthink(link is external)

“Bringing America’s Multilateral Diplomacy into the 21st Century(link is external)”,

The UN is the depository of more than 560 multilateral treaties(link is external)

The Law of the Sea Treaty of 1982

The Outer Space Treaty of 1967

Nuclear and non-nuclear weapons limitation treaties

The Antarctic Treaty of 1959

None is perfect; all treaties have to keep up with the times in order to survive, and all treaties leave some gaps to be solved later. 

The event is a call to action on two fronts: ensuring the safe use of near-Earth orbit and dealing with the dangerous escalation of anti-satellite technology(link is external).

Seeing America pulling back from the world and divided, China announced its plans to replace the United States as the most powerful nation on earth. 

resentment of the middle class.

Young Americans who came of age in the 2000’s have never known a time of peace and tranquility. 

five elements are required: (1) involvement of all the essential stakeholders (those that could make or break an agreement), (2) consensus definition of the problem, (3) sufficient common interests to generate a productive dialogue, (4) a shared commitment by the stakeholders to finding a solution, and (5) successful post-agreement implementation that stands the test of time.

The lack of a genuine partnership between the worlds of science and diplomacy to integrate multidisciplinary subject-matter

Today our diplomats are not trained in the scientific aspects of dealing with issues of global health, climate change, energy renewal, cyber threats, food and water resources, regional or global supply chains and outer space among others.

No global issue of significance today or for the foreseeable future will be solely national - allocating more of the diplomatic circle graph to the multilateral slice is both in our interest and more likely than ever to be the methodology of the future.

to engage with the larger issues looming just over the horizon.

is consumed with managing the moment, the immediate.

by engaging with others at the “early stages” of issues to keep us on the front lines of managing global trends.

one that recognizes the changing nature of the challenges we will inevitably face in the future – not just the problems we face now.

The Luddites were not anti-technology; what they wanted was economic justice.

A.I. researchers are increasing the concentration of wealth to such extreme levels that the only way to avoid societal collapse is for the government to step in.

the only way to make things better is to make things worse.

What Žižek advocated for is an example of an idea in political philosophy known as accelerationism

it seems like a way for the people developing A.I. to pass the buck to the government.

A.I. assists capital at the expense of labor.

by hiring consultants, management can say that they were just following independent, expert advice.

we rely on metaphor,

it triggers a mental shortcut in the minds of users that we call a “machine heuristic.” This shortcut is the belief that machines are accurate, objective, unbiased, infallible and so on.

Copyleft licensing allows for content to be used, reused or modified easily under the terms of a license – for example, open-source software.

But with self-driving cars, the engineers can never be sure how it will perform in novel situations.

that people treat computers as social beings when the machines show even the slightest hint of humanness, such as the use of conversational language.

Such beliefs build on “automation bias” or the tendency to let your guard down when machines are performing a task

However, if not coupled with resources and pressure to actually perform this sector-specific adaptation, this approach runs the risk of resulting in no meaningfully binding regulation at all.

a unique blend of horizontal and vertical elements

sectoral regulators will be outmatched in their efforts to meaningfully constrain businesses applying AI.

If agencies do not coordinate to build common regulatory tools, they risk reinventing the wheel each time a new department is tasked with regulating a specific application of AI.

if industry-dominated standards bodies set weak standards for compliance, the regulation itself becomes weak.

Their legislative bodies will need the ability to amend or add to its main horizontal regulation in order to keep pace with the technology.

the heavy lifting of articulating specific compliance thresholds will be done by Europe’s main standardization bodies

the EU’s broad approach will stifle innovation, and analysts correctly assert that China’s targeted regulations will be used to tighten information controls.

they effectively function to shift power from technology companies to government regulators

such as their sources for training data and potential security risks.

the algorithm registry

disseminating information, as well as setting prices and dispatching workers.

has taken a fundamentally vertical approach: picking specific algorithm applications and writing regulations that address their deployment in certain contexts.

the standards process has historically been driven by industry, and it will be a challenge to ensure governments and the public have a meaningful seat at the table.

Another factor is whether the proposed central and horizontal European AI Office will be effective in supplementing the capacity of national and sectoral regulators.

risk-based approach

the dual imperatives of providing predictability and keeping pace with AI developments.

the requirements in the AI Act with co-regulatory strategies

The easiest way for developers to satisfy these mandates will be for them to adhere to technical standards that are being formulated by European standards-setting bodies.

Applications deemed to pose an “unacceptable risk” (such as social scoring and certain types of biometrics) are banned. “High risk” applications that pose a threat to safety or fundamental rights (think law enforcement or hiring procedures) are subject to certain pre- and post-market requirements. Applications seen as “limited risk” (emotion detection and chatbots, for instance) face only transparency requirements. The majority of AI uses are classified as “minimal risk” and subject only to voluntary measures.

In a horizontal approach, regulators create one comprehensive regulation that covers the many impacts AI can have. In a vertical strategy, policymakers take a bespoke approach, creating different regulations to target different applications or types of AI.

in July last year that about 40% of young people turn to TikTok or Meta Platforms-owned Instagram when searching for restaurants, citing an internal study.

Bing’s share of the search market has remained below 3%

to ask follow-up questions or swipe through visuals such as TikTok videos in response to their queries.

an advertising business that made more than $162 billion in revenue last year.

It plans to incorporate more human voices as part of the shift, supporting content creators in the same way it has historically done with websites, the documents say.

2023:

The hardware, hilariously, became very easy to procure because of the recent crypto mining boom and bust. Several companies offering AI hardware in the cloud were actually crypto mining operations until recently.

The people who are already well versed in something are going to be the ones capable of making the most helpful applications for that particular field or industry.

arent there already LLM models that cite their sources? or I heard that new plugin with chat GPT can cite its sources

The general consensus is that, especially customer facing automation, MUST be "explainable." Meaning whenever a chat bot or autonomous system writes something or makes a decision, we have to know exactly how and why it came to that conclusion.

They are caught up in the hype and just like everyone else have zero clue what's actually going to happen.

Across the global South, the conflict in Ukraine is seen largely as a European affair, one without an obvious hero or villain.

The overwhelming majority, 720 million, lived in Latin America, Africa, and Asia. More than 400 million lived in Latin America alone. By 2025, only one in five Catholics will be a non-Hispanic Caucasian.

the Holy See has practiced what academics call the “great power” model of diplomacy, attaching itself to the superpower of the day.

More Catholics than ever before live outside the West and don’t see the war in Ukraine on the same terms as Europe and the United States do.

the Stanford Politeness Dataset,

ensuring the LLM produces reliable outputs for a particular business use-case often requires additional training on actual data from this domain labeled with the desired outputs.

a fine-tuned Large Language Model (LLM; a.k.a. Foundation Model).

Only half say their organizations are well prepared to anticipate and react to external shocks, and two-thirds see their organizations as overly complex and inefficient.

to shore up resilience

Open source alternatives can and will eventually eclipse them unless they change their stance. In this respect, at least, we can make the first move.

Research institutions all over the world are building on each other’s work, exploring the solution space in a breadth-first way that far outstrips our own capacity. We can try to hold tightly to our secrets while outside innovation dilutes their value, or we can try to learn from each other.

Part of what makes LoRA so effective is that—like other forms of fine-tuning—it’s stackable. Improvements like instruction tuning can be applied and then leveraged as other contributors add on dialogue, or reasoning, or tool use. While the individual fine tunings are low rank, their sum need not be, allowing full-rank updates to the model to accumulate over time.

calling this the "Stable Diffusion moment" for LLMs.

their efforts are rapidly being eclipsed by the work happening in the open source community.

Yuval Noah Harari

The Vedic principles have influenced the Indian psyche for many centuries. These principles have underpinned the socio-cultural-religious framework for the development of individual and social moral principles. The Indian psyche and society is in a phase of rapid evolution. Pursuit of Artha and Kama are overtaking the responsibility of Dharma.

Dharma embraces every type of righteous conduct, covering every aspect of life, both religious and secular, that is essential for the sustenance and welfare of the individual, society and creation.

Ontological nature of existence and Dharma (which approximately translates into morality).

These teachings comprehensively bring out the essence of Vedas, primarily Upanishads, in a language that is less terse than that in the original Upanishads

It is then that Lord Krishna enlightens him through the teachings that together form the Bhagavad Gita.

It forms a part of the great epic, Mahabharata which is traditionally ascribed to the sage Vyasa.

The Bhagavad Gita

set of dialogues

Upanishads are passages from the Jnana-kanda section of the Vedas. They are the core of Vedic wisdom and are essentially philosophical in nature

These four Vedas are further divided into two parts, Karma-Kanda and Jnana-Kanda. Karma Kanda is the section dealing with rituals and prayers while Jnana-Kanda deals only with the ontological realities – the nature of world, consciousness (or self) and God known as Brahman in the Vedas

Gilligan argued that females act from concerns about social relationships and that their moral development has elements of compassion and caring strongly built in. On the other hand, according to her, justice dominates men's morality.

The next stage is that of “Autonomous morality”, in which they are able to move beyond the consequences and are able to see morality as linked to intentions and that rules are flexible.

The first stage is that of “Heteronomous morality” in which children are able to see rules as fixed and dictated by authority

both our genetic makeup and the environment we experience would influence our overall development, including our moral development.

AI platforms such as ChatGPT

the Belarus Russia-inspired attempt

l anticipatory diplomacy.

The policy response has been different, too, with the European Union has taken a predictably tougher stance by proposing to bring in a new AI Act that segregates artificial intelligence as per use case scenarios, based broadly on the degree of invasiveness and risk

Do we want a world filled with A. I. systems that are designed to seem human in their interactions with human beings?

Making them bear at least some liability for what their models do would encourage a lot more caution.

liability.

The government needs to do more here than just write up some standards. It needs to make investments and build institutions to conduct the monitoring.

evaluations and audits.

Any firm building A.I. systems above a certain scale should be operating with hardened cybersecurity

security

whether this problem is solvable.

interpretability

China seems perfectly willing to cripple the development of general A.I. so it can concentrate on systems that will more reliably serve state interests.

Should there be an opt-out from A.I. systems?

“you should be able to opt out from automated systems in favor of a human alternative, where appropriate.”

This, too, is essential, but we do not understand these systems well enough to test and audit them effectively.

For now, we have no idea what is happening inside these prediction systems.

But where the European Commission’s approach is much too tailored, the White House blueprint may well be too broad.

“alignment risk,”

Choosing this strategy meant “repeatedly catching on fire, crashing into other boats, and going the wrong way on the track,” but it also meant the highest scores, so that’s what the model did.

Those sets can’t plausibly be free of error, and it’s not clear what it would mean for them to be representative.

“training, validation and testing data sets shall be relevant, representative, free of errors and complete.”

as new A.I. systems have already thrown the bill’s clean definitions into chaos.

That’s where the government comes in — or so they hope.

The United States-India technology corridor will give India the skills, technology, markets, and confidence to become a global player. 

the United States must openly communicate the path for reduced controls toward India, and India should dismantle barriers through exceptions for American technology companies to enable true partnerships to form

Policymakers in the United States and India should both work to reform trade policies and promote an open system of technology transfer and innovation between the two countries.

They must also think in more ambitious terms, planning for massive expansions that would rival China in terms of the size and scope of their factories, fabrications, labs, and operations.

Take India’s Aadhaar, for example, the world’s largest and most sophisticated biometric identification system that remarkably enables efficient and secure payments using just an ID number (compared to the near-century old American Social Security number standard)

India is poised to be an increasingly influential economic actor, and its growth can help compensate for America’s loss of trade with China under re-globalization. 

from one of outsourcing to one of radical collaboration

But by collaborating with American companies and encouraging reciprocal cycles of innovation, more Indian companies can become genuine technological leaders, developing original intellectual property with its deep wells of talent.

In 2020, after a series of border disputes with China, the Indian government banned dozens of well-known Chinese apps, including TikTok, from India.

If India’s technology sector wants to continue expanding and modernizing, public officials in India need to think strategically about India’s relations with international partners in this next stage. 

Thanks to the establishment of technical education through the Indian Institutes of Technology in the 1950s and 60s, India was able to cultivate a large pool of skilled professionals

But when it comes to technology, a sector in which clear decoupling has begun, India must choose which partner it wants to prioritize. 

Trade relations with the United States are important at $100 billion a year but trade with neighboring China is double that

While globalization will continue as normal for certain industries — basic consumer goods where consumer surplus is high and existential risk is low, for example — other sectors are moving toward some degree of decoupling, chief among them technology

It is neither complete interconnection nor complete decoupling, but rather a mix of the two. 

Re-globalization is distinctive from the economic systems which preceded it: During the period before World War I, and then again over the past 30 years, global interconnection was the norm, as goods and services proliferated easily across the world thanks to open markets and favorable regulatory environments.

the most important potential geo-economic partner for the United States today as it “re-globalizes” with greater concern for national security and resilience.

And as the United States’ concerns about China grow, India shines as a promising alternative in supply chains, innovation hubs, and joint-ventures.

the BRICS are looking to progressively develop and encourage the production of medicines and vaccines, with the aim of eventually breaking away from their dependance on Western pharmaceutical companies

Xi now wants the club to expand and admit Saudi Arabia, Iran, Indonesia and Argentina.

The two countries signed a total of 15 agreements, covering technology, satellites, semiconductors, 6G, artificial intelligence, internet expansion, climate, tourism, investments in clean energy, and other strategic sectors

The two countries signed a total of 15 agreements, covering technology, satellites, semiconductors, 6G, artificial intelligence, internet expansion, climate, tourism, investments in clean energy, and other strategic sectors.

Cable breaks and damage happen all the time on UK broadband networks the size of Openreach’s, and they’re usually caused by accidents, such as third-party contractors ramming their diggers into the wrong patch of ground. But only very rarely do we see damage as bad as the one caused by a landslip in Kent this week.

the Moscow-backed International North South Transport Corridor (INSTC), a 7,200-kilometere network of trains, roads and sea routes to connect Russia to India through Iran and Central Asia.

the maiden India-Central Asia Joint Working Group (JWG) meeting on Chabahar in Mumbai

The risk is that this coming together deepens the estrangement of the global south from the international order. It would be a tragic result if, in uniting the West, America alienates the rest.

China can undermine the effectiveness of global institutions

Western unity to hold

It will prioritise relations with its core democratic allies in Europe and Asia (which it hopes might one day include India)—and then try to maintain creaking global institutions in order to mediate meet the needs of a broader group of countries, including most non-aligned ones, whether on development, debt relief, security or finance.

Chinese visitors bring loans and engineers while Americans bring playlists.

“Countries don’t want to choose, and we don’t want them to,” Jake Sullivan, Mr Biden’s national security adviser

AidData also finds that a 10% increase in voting similarity with Beijing at the un is associated with an increase in the number of Chinese projects in that country.

Between 2007 and 2020 it provided more infrastructure financing in sub-Saharan Africa than the next eight lenders combined

China is the main trading partner for around 120 countries.

It draws a contrast with the West, which it says prefers smaller clubs (like the g7). “China shows up where and when the West will not,” says Yemi Osinbajo, Nigeria’s outgoing vice-president.

The non-aligned countries want to avoid taking sides.

China offers “hardware”: bridges, roads, ports—and the loans to build them.

West has generally been the preferred source of “software”: support for schooling, health and, should the African government want it, human rights

audi Arabia and the United Arab Emirates

Qatar is playing novel diplomatic roles.

Last month Saudi Arabia signed a Chinese-brokered deal with Iran and joined the Shanghai Co-operation Organisation, a Eurasian talking shop.

Saudi Arabia,

Turkish exports to Russia reached $7.6bn in 2022, a 45% increase on the previous year.

he “New Turkey” can select its partners.

Turkey also wants to be more influential across the global south