Teamsite: IWDataDeploy FAILED TDbSchemaSynchronizer create failure

Interwoven Teamsite is the worst piece of software i have ever used, and googling its errors gives you 0 hits. I am going to do the world a favor and change that!

Problem: I needed to deploy DCT data to the table which teamsite uses for its own record keeping. The file which takes care of this deployment is called AREA_dd.cfg where area is the name of the DCT. After making sure that teamsite is using the correct db info, and that all fields i was deploying existed i was getting the error: IWDataDeploy FAILED, where the root cause might have been:
(from the log in OD_HOME/OpenDeployNG/log/iwddd_something.log)

DBD: SELECT * FROM USER_TABLES WHERE TABLE_NAME='IWTRACKER'
DBD: Table [iwtracker] exists.
DBD: DEFAULT__DEVICE__MAIN_STAGING not registered
DBD: Error occured in TDbSchemaSynchronizer
DBD: ERROR:TDbSchemaSynchronizer create failure.


(DEVICE is the name of my DCT)
Solution:
This solution is a hack, but it works. Open the database you are trying to commit to from teamsite, and run the following SQL query:
INSERT INTO IWTRACKER (NAME) VALUES('DEFAULT__DEVICE__MAIN_STAGING');
COMMIT;

where instead of 'DEFAULT__DEVICE__MAIN_STAGING' put the thing which the previous error claims is not registered. Save the DCT again and tail the log, the deployment should succeed. (if it fails, you are probably screwed because the support is terrible and the documentation is teh suck)

edit 11/6/2009: I no longer use teamshite, so please dont ask me any questions about this evil thing, i wont know the answers.

Find and replace with VI

this will replace all occurrences of match_pattern in the file

:g/match_pattern/s//replace_string/g
alternatively, you can use ' : ' instead of ' / ' to make path (/) slashes easier to manage (no escape (\) character needed)
:g:match_pattern:s::replace_string:g

Using EL in custom tags as attributes

Problem:
I was working on a custom tag and i needed to pass it a bean from a JSP page kind of like this:
<customtag var="${somebean.something.else}">
I realized that what i was getting inside my custom tag was a String, not my bean.

Solution:
You need to use the ExpressionEvaluator to evaluate the expression, and get the bean, here is the code i used in my SimpleTag: (i was getting a Date object by the way)

<br /><br />ExpressionEvaluator eval = getJspContext().getExpressionEvaluator();<br />Date date = null;<br />//dateVar this is the EL expression<br />try { //this thing here resolves the date expression into a java object!<br /> date = (Date)eval.evaluate(dateVar, Date.class, getJspContext().getVariableResolver(), new FunctionMapper(){<br />public Method resolveFunction(String arg0, String arg1) {<br /> return null; //i couldnt figure out how to get a FunctionMapper from somewhere...<br />}<br /> });<br />} catch (ELException e1) {<br /> throw new JspException(e1);<br />}<br />


Edit Aug 7, 2008:
It has come to my attention that in jsp 2.0 the EL expressions are evaluated before being passed to the custom tags, so you dont need to do any of this crap anymore.

how to make .so files load in unix

Ive had this problem too many times and so i should blog the solution. The problem usually looks something like this: You try to run something and you get an error screaming about failing to load some file ending in .so

example:

failed: Can't load '/app/teamsite/iw-perl/site/lib/auto/DBD/Oracle/
Oracle.so' for module DBD::Oracle: ld.so.1: perl: fatal: libnnz10.so: open failed: No such
file or directory at /app/teamsite/iw-perl/lib/DynaLoader.pm line 229.

solution:

All these .so problems seem to be have a common solution. You need tell unix where to look for your libraries. This is how you do it.

1. Figure out where your application has its .so files. Usually this is in a directory called lib, and it usually contains more then one .so file.
2. You need to become root, and run this command:
3. crle
4. write down everything which is output, because if you break things you will need to go back to this. On solaris 10 this is the important piece which has to always be in the output: Default Library Path (ELF): /usr/lib
5. Now we need to add our library locations to the Default Library Path, run this as root:
   
6. crle -c /var/ld/ld.config -l /usr/lib:/your/directory/where/the/so/files/are
7. exit root

Now try to run your application and see if it runs. If it does not run then it may complain about another .so file in another directory which you missed. You will need to add it to the end of the path in step 5 like this:
crle -c /var/ld/ld.config -l /usr/lib:/your/directory/where/the/so/files/are:/another/lib/path

Important: if you remove the /usr/lib part from the Default Library Path, shit will hit the fan.
Use this at your own risk.

Flash in IE6 xml compression problem

Problem:

There seems to be a problem with flash player running on IE6 loading XML files from a web server which has compression enabled. It seems like the XML is never decompressed correctly, so whatever flash that is using it breaks. Everything seems to work fine if you use firefox or IE7 to access the same flash swf. I found one page talking about this problem, right here:

http://blog.mediacatalyst.com/pivot/entry.php?id=281

Solution:

First let me say, that on our servers the XML was generated by a JSP, so i had a bit more control over html headers and such. This is what i did to solve this problem:

1. Set Cache-Control HTML header to nothing ("")
   
2. Set Pragma HTML header to nothing
   
3. Make sure that the XML file had the XML declaration as the very first thing in the file
4. Set the JSP page content-type to text/xml

How to backup firefox plugins

I needed to back up my plugins to install the DOM inspector, which requires a firefox reinstall. Here is how to back up the firefox plugins:

C:\Documents & Settings\USERNAME\Application Data\Mozilla\Firefox\Profiles\
there are directories in there
copy those out to save them
then.... after you reinstall, copy them back and run "firefox -profilemanager"
and create a "NEW" profile using the directory you just copied

It works cross platform also... put the stuff on a jumpdrive and have the same profile in Linux and Windows

source: www.jacobsylvia.com

How To: Implement RMI from scratch

The java.lang.reflect.Proxy class will let you provide an arbitrary implementation for an interface.

So, start with that on the client. Figure out how to produce a factory for interface objects. Understand how the proxy invocation works.

Then, create a socket connection to the server. Wrap it with an ObjectInputStream/ObjectOutputStream.

Now you need to define a protocol between client and server. For example, let's say that the client sends an integer object ID, followed by a method name, followed by an array of parameters. The server needs to find the object, and invoke the appropriate method. Then it needs to send the result back to the client.

Then you can get into distributed GC ...

source: java dev forums

JSP: custom tag to modify its body

This is a skeleton of what is needed to build a custom jsp tag which does something to its body. For example a tag could change the urls of all the links found in its body.

<br />package com.mycompany.package.of.the.tag;<br /><br />import javax.servlet.jsp.JspException;<br />import javax.servlet.jsp.JspWriter;<br />import javax.servlet.jsp.tagext.BodyContent;<br />import javax.servlet.jsp.tagext.BodyTagSupport;<br /><br />public class CustomTag extends BodyTagSupport {<br />private static final long serialVersionUID = 1L;<br /><br />public int doAfterBody() throws JspException {<br /> try {<br /> BodyContent bc = getBodyContent();<br /> String body = bc.getString();<br /> // do something to the body here.<br /> JspWriter out = bc.getEnclosingWriter();<br /> if(body != null) {<br /> out.print(buff.toString());<br /> }<br /> } catch(IOException ioe) {<br /> throw new JspException("Error: "+ioe.getMessage());<br /> }<br /> return EVAL_BODY_INCLUDE;<br /> }<br />}<br />

make a file called CustomTag.tld and put it into WEB-INF:
<br /><?xml version = "1.0" encoding = "ISO-8859-1" ?><br /><!DOCTYPE taglib<br />PUBLIC "-//Sun Microsystems, Inc.//DTD JSP Tag Library 1.1//EN"<br />"http://java.sun.com/j2ee/dtds/web-jsptaglibrary_1_1,dtd"><br /><taglib><br /><tlibversion>1.0</tlibversion><br /><jspversion>1.1</jspversion><br /><uri>com.mycompany.CustomTag</uri><br /><shortname>Custom Tag</shortname><br /><tag><br /><name>ct</name><br /><tagclass>com.mycompany.package.of.the.tag.CustomTag</tagclass><br /><bodycontent>JSP</bodycontent><br /></tag><br /></taglib><br /><br />

use it like this on your JSP:
<%@ taglib uri="com.mycompany.CustomTag" prefix="x"%>

<x:ct>
here is some stuff inside the tag!
<c:out value="${someparam}"/>
</x:ct>

How to make a redirect servlet

make a servlet which calls the following method on doPost() and on doGet()

<br />private void doRedirect(HttpServletRequest request, HttpServletResponse response) throws ServletException {<br /> String servletPath = request.getServletPath();<br /> //do something with the path<br /> String newServletPath = servletPath.toLowerCase();<br /> try {<br /> getServletContext().getRequestDispatcher(newServletPath).forward(request, response);<br /> } catch(IOException ioE) {<br /> throw new ServletException("Unable to forward request: " + servletPath + " to path: " + newServletPath, ioE);<br /> }<br />}<br />

improve eclipse performance in windows

this eclipse plugin forces windows keep eclipse in memory / reduces thrashing

http://suif.stanford.edu/pub/keepresident/

UNIX: list what sudo permissions you have

> sudo -l
Password:
You may run the following commands on this host:
(root) /usr/local/apache/bin/
(root) NOPASSWD: /app/teamsite/iw-home/opendeploy/bin/iwsyncdb.ipl
(root) NOPASSWD: /etc/init.d/smb
(root) NOPASSWD: /usr/local/samba/bin
(root) NOPASSWD: /bin/vi /etc/group
(root) NOPASSWD: /usr/local/bin/top
(root) NOPASSWD: /bin/vi /etc/group
(root) NOPASSWD: /usr/bin/ls
(root) NOPASSWD: /usr/ucb/vipw
(root) NOPASSWD: /usr/local/bin/top
(root) /bin/tail

Javascript: matching with regex

There seem to be 3 ways to use regular expressions in javascript:
1.
var val = document.getElementById("some_id").value;
val.replace(/^\s+|\s+$/g, ""); //trim using regex
2.
var alpha = /^[A-Za-z]+$/ ;
var val = document.getElementById("some_id").value;
if(alpha.test(val)){
//val matches alpha
}
3.

var val = document.getElementById("some_id").value;
var alpha ='((?:[a-z][a-z]+))'; // Word 1
var p = new RegExp(alpha,["i"]);
var m = p.exec(val);
if (m.length>0)
{
   var word=m[1];
   //word is the capture group 1
}

if anyone knows a better way, feel free to share.

NoClassDefFoundError: com/sun/mail/util/SharedByteArrayInputStream

problem:
when trying to send mail i get error: NoClassDefFoundError: com/sun/mail/util/SharedByteArrayInputStream

solution:
get mail.jar and put it on your classpath

http://java.sun.com/products/javamail/downloads/index.html

Java: find nested balanced tags

Problem:
I needed to parse out some divs from a html page, and java's regex cant do it. atleast when you have arbitrary number of nested balanced elements.

Solution:
<br /><br />private String removeDivContents(String id, String clazz,<br /> String text){<br />String div = "<div class="\"><br /> +clazz.toLowerCase()+"\" id=\""+id.toLowerCase()+"\">";<br />String textl = text.toLowerCase();<br />int index = textl.indexOf(div);<br />if(index == -1){<br /> return text;<br />}<br />int loc = index + div.length();<br />int end = findBalancedClosingTag(loc, textl,<br /> "<div","</div>", 1);<br />return text.substring(0,index) + text.substring(end);<br />}<br /><br />private int findBalancedClosingTag(int start,<br />String textl, String startTag, String endTag, int unClosedStarts){<br />int index = textl.indexOf(endTag,start);<br />if(index == -1){<br /> return start;<br />}<br />Pattern p = Pattern.compile(startTag);<br />Matcher m = p.matcher(textl.substring(start, index));<br />unClosedStarts --; // we are in this function so we closed ONE start tag<br />while(m.find()){<br /> unClosedStarts ++;<br />}<br />if(unClosedStarts == 0){<br /> return index + endTag.length();<br />} else {<br /> return findBalancedClosingTag(index + endTag.length(), textl, startTag, endTag, unClosedStarts);<br />}<br />}<br />
Use at your own risk.

UNIX: dd trick to speed up disk access times

This was stolen from the Lucene mailing list as a strategy to warm up an IndexSearcher:
Something like dd if=/path/to/index/foo.cfs of=/dev/null
Basically, force the data through the kernel preemptively, so FS caches it.
Run vmstat while doing it, and if the index hasn't been cached by the FS, you should see a spike in IO activity while dd is running.

source: (something in the middle of the thread)
http://www.gossamer-threads.com/lists/lucene/java-user/43418

java.lang.NoSuchFieldError:prohibited Lucene Highligher

Problem:

java.lang.NoSuchFieldError: prohibited
    at
org.apache.lucene.search.highlight.QueryTermExtractor
.getTermsFromBooleanQuery(QueryTermExtractor.java:91)

Solution:

You are using an old (pre 1.9) highlighter lib on a
1.9+ lucene. You need to pull the latest highlighter
sources from the svn repos, make a jar out of them and
use that inst

also, 'prohibited' referes to actual method param inside
of highlighter. 

nice regex util class, replaceAll

elliotth.blogspot.com/java-implementation-of-rubys-gsub.html

Here is an example of what this does:

String result = new Rewriter("([0-9]+) US cents") {
public String replacement() {
  long dollars = Long.parseLong(group(1))/100;
     return "$" + dollars;
  }
}.rewrite("5000 US cents");
System.out.println(result);

prints>> $50

nice!

java.io.IOException: read past EOF on Lucene

Problem:
This is the error:
java.io.IOException: read past EOF

Lucene throws that error when you try to read an index.

Solution:
The lucene index was most likely corrupted at some point. In my case, it broke during the ant's copy in the deployment.

Other pages say that it may be because the index uses a weird char set where chars may be bigger or smaller then what you think they are, so if you think they are 8 bits, and they are actually 7, you will read past EOF.

using cron on solaris

crontab -l

figure out whats in your cron, copy to a file called myCron
modify the file and add the crap you want
50 13 * * * /usr/local/subversion/svnbackup.sh
this runs the script at 1:50pm every day
then copy the file into the cron:

crontab < myCron

yey!

UNIX: delete files older then X days old

This can be useful when making a rolling backup script

find /directory -type f -mtime +12 | xargs rm

/directory: your directory name that the files are under (rename appropriately)
-type f: only delete files (not subdirectories)
+12: older than 12 days old