Sunday, October 28, 2007

The meta-effect

Alan Turing, the mathematician, and father of computer science, died trying to prove somethings are fundamentally unprovable[1].
Finally this long-awaited article comes to light. People who read it might actually think I am really crazy. But I will write it anyway. I don't actually know if this is an already-defined theory with another name or not, but I've been thinking in it for a while now.

The meta-effect happens in every day life, and in different ways, but we never notice it. I've been able only to know 2 instances of it, one of which only exists in the meta-effect itself.

I don't know how to start but through an example, and I have one example as said above. You learn how to sum 2 numbers. Your teacher taught you how to sum two numbers, and he had learned how to teach you how to add 2 numbers. The guy who taught him how to teach you how to add two numbers have learned that too! I don't actually care about any of these facts, only do notice that I can go for ever.

How do humans learn things ? How do humans learn how they learn things ? How people analyze how they learned about they learning things ? Common fields facing that particular effect are psychologists, sociologists and natural language programmers.

That meta-effect things needs a lot of studies to know its true nature. For example, to which level should we go ? Or can we know a level without the other ? At which level there is no more useful information ? Do we need to advance to another level ?

The most fascinating aspect of all that, is how human mind can elevate in meta-levels like that. Studying the effect of how human analyze how their mind are in a higher meta-level, lets call it: meta-cognition-level-2, for short MCL2. In my last article what I was speaking about is MCL2. While we analyze MCL2, we are elevating to MCL3. As a rule-of-thumb, when you give a level a name, say MCL(n), you are actually at level MCL(n+1). In MCL2 we talk at MCL1. And when we talk about MCL2, we are at MCL3.

Warning, the next is much more complex!

We talked about meta-effect in learning, or some topic. What if that topic was the meta-effect itself ?! There is meta-levels, in a single topic. Each level analyzes the level beneath it. But what about analyzing the meta-levels itself (like in differentiation in calculus*). Let's call that, meta-meta-effect. Is there is a single meta-meta-effect for all topics, or there is separate one for each topic, or there is both ? Is the former a higher (another kind) of meta-meta-effect ?

Generalization

If we give a thread of cognition stream the name m/l/t, where m is the differential meta-level, l is the ordinary meta-level, and t is the topic, where t* is applicable to all topics. Normal everyday talk or thinking is 0/0/t*. Some advanced experience of learning activities involving consideration of previous learning experiences, is 0/1/t*. M/L/T (big letters are free unbound variables, means applicable to anything) where M > 0 is only applicable when talking about meta-effect.

Well, I might go more analytical next post isA.

[1] http://bestdocumentaries.blogspot.com/2007/09/dangerous-knowledge-full-documentary.html
* Cool, this might lead to some new science called cognitive calculus :D

Wednesday, October 10, 2007

30 Minutes is not the same as half an hour

No it isn't playing with the words, so stop trying to figure it out that way.
As usual I have been digging in some stuff, this time related to Natural Language processing. And on the other side, I had to determine an estimate for a task in my work. Usually we measure tasks by hours. But the task was somehow small that it takes less than an hour. So I wrote 30 minutes.
After I sent the mail, I kept thinking, why didn't I write half an hour ? Inherently "half an hour" is more rough estimate than 30 minutes. Exactly like when you measure yourself to one and a half meter, against 150 cm.
It is about the scale, no; it is about the precision. I've always been fascinated how reading that the government have spent 30 Billion LE on that project seems normal, while reading that it spent 30,000 Million LE seems huge! Reading that it spent 30,000,000,000 LE would seem gigantic. 3 * 10^10, almost means nothing. Although they represent the same quantity.
What have derived this idea, is thinking how an NLP program will ever comprehend such style in understanding, which I believe is very related to how human mind evaluates things. It maybe even somewhat related to psychology than reasoning; subconsciously: that number takes that many characters, then it must be huge!
A theory I've been thinking in for a while, in NLP and Natural Language Understanding in specific, is that most babies know nothing about languages when they are newly born. Yet they function correctly. So language is complementary, but not essential in learning. Language only aids learning by adding new means to it: communication.
So I believe that before any serious trials are made to make a full natural language understanding program, knowledge representation and learning methods need to be formalized first. You can't add communication facilities to a program that will not use it. Well, in fact you can, but it is useless.
Babies see a bottle, then most of the time, they hear 'bottle', so according to the famous psychology phenomena "Conditioning"[1], both events: seeing a bottle, and hearing the word 'bottle' stimulate each other. That's simplified. It is actually kind of statistical learning. Over time, they learn to be more sensitive to some phonemes than the other, depending on the inherent probabilities in the language most common in their environment. "Koreans notoriously fail to distinguish 'l' and 'r' sounds"[2].
If I would guess similar pattern for vision, and motor skills. For example, I might guess that babies might see the percepted image as-is, but with the aid of the 3 dimensional perception, they can notice certain patterns as they move around, leading to detecting the boundaries of objects. As they do that, and over time, they learn the patterns, and the colors, and learn to use them to distinguish objects and extract them. I might use the existence of optical illusions as evidence. Somewhere in your childhood you have mixed objects like that. Kids usually deal with big cubes and learn the dimensions to sharpen the object-detection neural networks in their brains. And they grow up they get more exposed to more complicated patterns, like text for example.
So if we assumed a simplistic model, that a human is a combinations of sensors, and a statistical pattern-matching learning machine, and non-linear initially-empty knowledge/rule base, that is stimulated by the sensors and the pattern matching machine, then we only need to figure out the inter-dependencies between them and also figure out the abstract functionality contract for each of them, to be able to create a real NLU program sometime.
What on the stage now is artificial hard-coded NLU programs. what I am seeking is a self-learning NLU program, that can teach itself languages, and can then teach itself everything. Of course, sensors are needs, experiments which the system should go through (life-experiments) should be available to the system. But one more thing, that were not in the past assumptions can destroy all that. The assessment problem.
The assessment problem
On what basis should the program accept of reject a new piece of knowledge ? The program till now is only a pure knowledge collection machine, stimulated by external events. What's the use ? The program must ponder the knowledge it gained, and assess the acceptable and non-acceptable pieces of knowledge, especially that there is a lot of contradiction out there, because knowledge available in the world is highly affected by personal view points and preferences. How the program will learn the ability to compromise between two conflicting facts ? If there is two different view points, how can the program choose one ? Or should it compromise or select one, or worse yet, select only two from a set of contradictions ?
Humans, have been forged to the good nature, such contradictions and wrong choices affect their nature after that. It's a matter of trust, which source should the program trust ? And one what basis should it grant or revoke trust ?
This is far beyond the scope of NLU, or machine learning, this.. is .. humanity ! Yes, this is1 human kind. No application what soever will be able to reach that state consistently and independently. As you might have noticed, this is not first-order knowledge. They might create applications that understand first-order knowledge better than the human (i.e. some advanced sort of databases), but they will never create a program that can reach arbitrary orders of knowledge. At least not one that will be close the the human. The humans will prevail the top in that.

This article is related to the meta-ization phenomena that I wanted to write about a long time ago, I don't recall I wrote it yet.

References:
[1] http://www.alleydog.com/101notes/conditioning.html
[2] http://www.asian-efl-journal.com/dec_03_sub.K1.php

Friday, October 5, 2007

تجربه: مقتطفات رمضانيه 2

ديه تجربه احط تدوينه من مدونتي السريه واشوف حتضحكوا عليا وﻻ لأ... اللي حيضحك حيعرف شغله!
لو حد عنده فكره
support
العربي زفت اوي كده ليه في بلوجسبوت يقولي

==============================================

التدوينه تبدأ من هنا ...

==============================================

المره دي التدوينه متفائله شويه

انا زي كل يوم مؤخرا مطحون طحن في الشغل و كان عندي فطار بره و كمان الشغل لازم يتسلم الساعه 9 و الشغل يدوب عليه الوقت اصلا من غير فطار. فضلت شغال لحد ما كان فاضل ربع ساعه على الفطار بقول حاخد تاكس. والمسافه اصلا برضه ربع نص ساعه كده حسب الناس متفقه عليا عشان تزحم الشارع ولا ﻷ. المهم قلت اخد معايا حاجه افطر بيها تحسبا للـتأخير.

المهم وانا في السكه التاكس بطء عشان واحد شاورله و فاضل 5 دقايق عالمدفع. اول ماقربنا من الواد اشرأب -حلوه اشرأب ديه- عنقه عادي يعني زي اي واحد بيوقف تاكس. التاكس طبيعي مفرملش عالاخر يعني و اذا بالواد يرمي لنا بشئ جوه العربيه. انا في الاول اتخضيت و بعد كده قلت اكيد ده اعلان - بس غريبه اعلان ايه ا للي قبل الفطار ده ؟؟ المهم طلعت في الاخر كيس بلح. انا بصراحه قعدت فتره على مستوعبت ان في ناس كده و بصراحه فرحت بيهم جداااا. و قعدت ادعيلهم من قلبي. و كمان شارعين لقيت اتنين تانيين. و كمان شارع لقيت واحد بيوزع ازايز ميه. و بعد منزلت من التاكس -و الادان بيدن- لقيت عربيه وقفت تديني بلح! لو شفتو التدوينه اللي قبلها والست اللي بتقول حاجه افطر بيها يابني. مش عارف اقول ايه يصراحه المهم ان انا مبسوط اوي.

الايام دي بروح المهندسين كتير. قبل كده كانت بالنسبه ثقب اسود لا ادري له مكان. المهم النهارده خدت بالي من حاجه عجبتني برده. الاشاره فيها عدادبيقولك فاضل كام ثانيه والاشاره تفتح او تقفل!! بصراحه حسيت اني احترمت اللي عمل كده عشان هو بيحترم السواقين. كان نفسي اخدلها صوره احطها بس للاسف معنديش كاميرا رقميه.

هي الحاجات ديه اللي مخلياني حموووت واشتري كاميرا..