A fighter pilot by day and a professional Swing developer by night. Meet Mikael Grev as the interview series on Swing, RIA and JavaFX that started with Amy Fowler continues.

Tell us a little bit about yourself.

Mikael Grev pictureI’m a geek and a fighter pilot. A strange and peculiar combination, I know, but it is true nevertheless. The duality was there from the beginning, playing Ice Hockey six days a week (against Peter Forsberg and Marcus Naslund no less) and coding demos on the Commodore 64/ Amiga the rest of the time.. My day job is in the Swedish Air Force, where I am an instructor on the Gripen fighter aircraft. All other time I run MiG InfoCom AB, a small consulting company. Married to an understanding wife, obviously no children. I would be surprised if your audience was interested in my military carrer, so I’ll leave that be :). When it comes to coding I have created Wing, a flight planning, coordination and evaluation system in use by the Swedish and Danish Air Force. I have also created MiG Calendar (and the site) which is the best selling Java component at the largest online reseller, ComponentSource. MiG Layout is my latest project. It is a FOSS (BSD) Layout Manager for both Swing and SWT that promises to put the fun back in hand coding GUIs… I am also quite proud of MiG Base64. Very geeky but fun for a performance freak like me.

You’re writing open-source and commercial Swing components primarily oriented at business applications. How do you think Swing fares as compared to competing toolkits, such as MFC, Delphi, GTK, Cocoa, QT and others?

In general, pretty well. I find the famous comparison to a instrument panel of a Boeing 747 particularly amusing, and accurate. If you know what you are doing it is extensible to the extreme. As a newbie, however, you can find yourself spending hours doing the simplest of customizations. The other frameworks are generally simpler and less configurable. Either what you want to do is easy or not possible at all. Much of the complexity in Swing comes from the IMO bad architectural choice to extend the AWT base classes for the Swing components and the lack of properties.

Other UI toolkits seem to have much larger variety of professional third-party component suites. Amy Fowler attributes this to the rise of web applications, but it didn’t seem to affect the market of Delphi and .NET components. What are your thoughts?

In Swing it is very easy to write simple components but very hard to write complex ones. Especially those that interact with other components during design-time. The support for having non-trivial properties is a nightmare and I have seen few other components than MiG Calendar that actually bothers with complex property editors. The reason is that the JavaBean spec is still at version 1.01 and has never been revised. There is a lot of trial-and-error when touching the outer parts of the spec since it is written in a very loose and open ended way. The problem with this flexibility is that it is interpreted in different ways by the different component container (IDE) vendors. Flexibility is often good, but here a more pragmatic approach would have been better, in retrospect. Since I have worked a lot with Swing, writing the actual components was not the hardest part, that was to make them work properly in all the IDEs. Especially the code->deploy->test-in-IDE- workflow is painful, time consuming and error prone. Without JFormDesigner I don’t think I would actually have made it.

JSR-273, where I am on the Expert Group, set out to firm up the JavaBean spec and provide for a better interface to components, especially under design-time. Unfortunately Sun was not interested in driving it to finnish. My conclusion is that Sun is not interested in a Swing component market.

In short, complex components are time consuming to create, hard to test in its target environment, and without a good channel to sell it. I also miss a good way to support licensing of the component within the IDE. VisualStudio, for instance, has direct suport for this.

What do you think about Sun’s new direction of client Java towards RIA space with JavaFX?

I have mixed emotions. Another layer? Hiding something under another layer is seldom good, unless you make that layer so darn good that you never have to see the plumbing beneath. If Sun release it prematurely, or force the developer to jump down to the Swing level all the time, it can turn ugly fast. Sun has little goodwill they can ride when it comes to desktop matters, JavaFX better be perfect when released or the complain-a-lots will blog it to death.

It is paramount that all demos coming out of Sun looks absolutely stunning. The need to be at least as good as the Silverlight and Flash/Flex/Air demos, probably even better since they are the under dog. When looking at The new JavaFX site I’m uncertain that the Sun hired designers are up to snuff. At least to me it looks, well… you know… but taste differs.

I would probably have put my money in a non-backwards compatible complete Swing overhaul (called SwingIT!) where real properties, translucency, animation, binding and all that fancy stuff was built in from scratch. On top of that I would have built the tools that the designers could use. I sometimes wonder who JavaFX Script is for? Designers won’t touch it for sure and I don’t feel like I as a Swing developer would gain anything, except maybe for prototyping or small cool effects applets (where Flash is king anyway).

What worries me the most about JavaFX is that they are still using the really, well… quality challenged… Swing layout managers. Primarily not because of the actual layout managers, but because the JavaFX architects don’t seem to understand what the the real problems are. Even now when they have the chance to start with a clean slate, they start new with old stuff that never worked that good. But… Time will tell. Maybe I’m just getting old and don’t want my Swing magic wand to loose its swinging power. :)

Are you planning to wrap your components for easier consumption in JavaFX applications?

To be honest I don’t know. Probably. Since it hasn’t been released I have too little information about the work needed to make a business decision. But if our customers want it, or JavaFX takes off like Sun think it will, I will do it for sure. I have been working a lot with GWT as of late and I actually like it, a lot. One cool, very AJAXy, interactive charting component, coming up!!

Can Swing be considered a premier choice for cross-platform UI development today? Would you recommend Swing for building large long-term business applications?

I get this question a lot and I never know what to answer. Or maybe more accurately, there is no short answer.. If you have good developers that have the time to put themselves properly in the know about Swing it is a good toolkit to use. Even more so if the app really needs to be cross platform. Most of Swing’s old problems are gone now. Performance and appearance have reached the level where they are no longer a problem. Though you can never just throw Swing at a large team of developers and let them have at it. Disaster would follow. A Swing project needs to be properly researched in advance to keep clear of the cavets. For instance, if you start using NetBeans and Matisse, which are both formidable tools in themselves, you have forever locked your team into that IDE when it comes to the GUI, and they are smarter than I am if they can alter the created GUI code by hand.. With proper research and initial study Swing can be recommended.

Would you want to see your products folded into the core JDK distribution, and why?

Yes I would. MiG Layout would help a lot of Java developers create good looking GUIs without them even thinking about it. White space and such are just handled automatically. Having MiG layout in the JDK would make it available to millions of developers compared to maybe 1% of that if it is kept outside as today. Only a fraction of the Java developers actually makes the effort to search the net for alternatives. Some don’t because they expect the best of breed to be included in the JDK and some because of the extra external dependency it would bring to the project. MiG Layout is now #14 at the TOP 25 RFE list and climbing fast. I know of no other official way to influence Sun in these matters, so why not cast a vote or two on it? (or three..)

Is there anything else you would like to add?

Pulling 9G:s I look just like my grandfather and my heart looks like a banana. ;)

This year’s JavaOne placed a significant emphasis on client Java. The name Amy Fowler should ring a bell for anybody who ever delved into the intricacies of Swing internal implementation, and she graciously agreed to answer a few questions that i had after attending most of the desktop track sessions.

Tell us a little bit about yourself.

Amy Fowler pictureA love for both drawing and math is what drove me to major in computer science at Cal Poly in San Luis Obispo. However, my passion for coding didn’t start until I discovered graphics and UI programming about the time X11 was battling NeWS on Unix desktops (anyone remember that famous t-shirt with the race car rendered half smoothly in NeWS and half pixelated in X11?) When Java debuted in 95, the only thing I wanted to do was work on its UI toolkit. I joined the Java team in late 95 and after a painful year of AWT hacking and toolkit wars (remember IFC? Bongo? WFC?) we snuck lightweight components into JDK1.1 and started building Swing. Except for a one year hiatus in the web tier working on JSF (where I couldn’t get over not being able to draw on the screen) I’ve spent the last 11 years working on Swing or related projects.

What is your current position and responsibilities in Java client group?

I’m a senior engineer in the Java Client Group. The team hasn’t let me touch the Swing source in a few years, but I still consider myself a toolkit engineer. I recently built a new demo, SwingSet3, to showcase the Nimbus look and feel in Java 6 Update 10. SwingSet3 is an open source project and it’s built to support 3rd party look & feels and demos, so I’d welcome outside participation. I hope to see the Substance look & feel there soon :-)

JavaFX seems to be the new direction of client Java. What are the recommendations of migrating medium and large business applications, and should they consider porting to JavaFX at all?

In my experience in working with enterprise developers, there is a very rational and grounded resistance to jumping to anything new. So caution is wise at this early stage. Though it’s great fun to render multiple video feeds into hundreds of translated, animating graphics nodes, most business app developers are worried about much more basic problems, like managing views into large data sets and validating forms data. These things will be doable from JavaFX script, as it has access to the complete Java platform, but patterns and mechanisms are still being worked out. In fact, it should be possible to take a well-architected Java application and migrate only the GUI, leaving much of the underlying Java business logic in-tact. So longer term I definitely see value in evolving larger apps to use JavaFX script, as the benefits of accelerated GUI development will apply there, just as it does to slick visual ware.

What is the target audience of JavaFX? Are you looking at Swing developers, at RIA crowd (Flex / AIR / Silverlight), or perhaps at the wider Web community?

There have been questions around our target audience for both JavaFX “in general” and the JavaFX Script language specifically. In terms of the general target audience, we obviously have to focus initially on meeting the needs of a specific community, which is the RIA crowd (is anyone else tired of acronyms?). They are clearly less resistant to trying something new, especially when it speeds up development and is built on Java, which has always been about the internet.

But longer term, how many applications won’t be rich internet applications? Increasing graphics hardware acceleration is enabling the trend towards more beautiful and fluid interfaces. Ben Galbraith highlighted this point in his excellent
User Experience JavaOne talk when he pointed out that user expectations have now been raised beyond just usability — they now expect to be wowed (recall Maslow’s Hierarchy of Needs from Psych 101). It may be that consumer applications are leading this charge, but in the end we’re all human beings and there is no reason why we shouldn’t feel as pleased with the applications we use at work as with those we use at home. And note that “beauty” encompasses both aesthetics and purpose.

So how do you get a beautiful application? You have it designed by people who understand visual design and usability. Period. Karsten Lentzsch once made a great point that “finding the design” is really the hardest part of building
a GUI. And up to this point, the Java platform has been aimed at developers, most of whom couldn’t “find” a design if it landed on their MacBook Pro. So we have to provide a paradigm in Java which enables designers and developers
to work more seamlessly in constructing beautiful applications. We believe that JavaFX script, in conjunction with existing designer tools (Photoshop, Illustrator, etc) and development tools tailored for building GUIs, is how we’ll get there.

Now to comment on the target audience for the JavaFX Script language.

It’s really different from Java and THIS IS A GOOD THING. For defining visually rich user interfaces, it has some major advantages over Java:

  • declarative syntax (without XML; no offense to the XML community, as XML has its place, but its verbosity is simply noise in a hierarchical GUI description)
  • first-class functions for callbacks (no more writing of anonymous inner classes — the JFX compiler handles those gory details)
  • expression-based binding (this is the power drill for GUI development; once you use it, going back to the hand drill is painful)

I’ll confess that I didn’t want to like it at first (felt a little like I was cheating on Java), but after I got over the hump of learning to declare what I wanted, rather than coding procedurally, it became quite addictive, especially binding. But don’t take my word for it; try it out yourself before you render an opinion.

Do we expect designers to code in it? Not any more than they currently code using JavaScript or ActionScript. Most of them will continue working visually with design tools, but if they had to make simple edits to JavaFX Script, that’s certainly doable. I will add that there’s a real geek component to JavaFX Script with sequences and bound functions that will appeal to the more sophisticated scripting programmer and make for some fun puzzlers.

There are quite a few features baked directly into the language such as binding, animations, effects and retained painting. While Swing code is pretty straightforward to debug, it would appear that debugging these JavaFX features requires some cooperation from the IDE developers. If this is correct, are you working with Eclipse, IDEA and NetBeans in this area?

IDE support is paramount, especially since JavaFX script is a completely new syntax and as you point out, has language features (such as binding) which will require special debugging support. The upcoming SDK will include a NetBeans plugin and I believe the popularity of IDEA and Eclipse will drive the creation of associated JavaFX plugins, either by Sun or 3rd parties.

With the comment about Swing code being straightforward to debug, I can’t resist putting in a plug for my favorite discovery at this year’s JavaOne: SwingExplorer an application that helps visually debug Swing by inspecting the containment hierarchy and stepping through paint operations. Our team always dreamed of building this but never found the time. Thank you, Maxim Zakharenkov.

We don’t see a lot of mature and professional third-party Swing component suites, especially compared to Delphi, .NET or even Flex. What are your thoughts on this subject?

We might not have the quantity of 3rd party component suites as other frameworks, but we certainly have a few very high quality ones: JIDE (David Qiao) and JGoodies (Karsten Lentzsch). And there is SwingLabs, which has a great extended component suite, led in heroic effort by Jeanette Winzenberg. There are also numerous popular 3rd party layout managers: FormLayout from JGoodies (along with JFormDesigner tool), and MiG Layout to name just a few.

Swing suffered incredible bad-timing in that just as we delivered its first release (late 90’s), JSP and web interfaces became all the rage. By the time folks realized every single application didn’t (and perhaps even shouldn’t) live inside HTML and the browser, Swing wasn’t the hot new thing on the block anymore. However, if you talk to the purveyors of the above frameworks, you’ll hear that their business is booming.

What would your recommendation be for third-party component developers? Should they wrap their components with JavaFX classes?

3rd party component developers should absolutely provide the appropriate JavaFX script wrappers so that these popular, seasoned components can be leveraged as first class script citizens using attributes, binding, and functions. The wrappers should be thin and so this shouldn’t be difficult. There may even be room for auto-generation mechanisms if the components are well behaved JavaBeans (which Swing components aren’t; sigh).

Recently a lot of JVM languages (such as Groovy, JRuby, Scala and Jython) have started using Swing as a “UI virtual machine”, using the same approach as JavaFX in providing more succinct and readable dynamic syntax for building user interfaces. Is this the future of Swing, with the new UI ideas and functionality developed in the dynamic languages?

There has been lots of internet buzz on this topic post-JavaOne. Many fear that we’re abandoning Swing and associated efforts (App Framework & Beans Binding) in favor of “everything FX script”. Not true. We realize that one size will never fit all and that this language diversity on top of the VM is only good for Java. And this, in my opinion, is the genius behind JavaFX: we are migrating to the next generation client paradigm by leveraging our existing stack rather than throwing it out and starting over. Project SceneGraph enables us to finally combine 2D, 3D, media, and animation with a stable, mature, well-rounded GUI suite (Swing & partners). Over time we’ll see more GUI components constructed from purely scene-graph nodes, but that will take time (it’s harder than you think).

In terms of evolving the platform, there will be times where we should innovate in the Java APIs, as this stands to benefit everyone using the platform, yet there will be areas where it’s wiser to focus on innovating in the more dynamic script layer. The latter will be particularly true when the script language features can play a key role in the innovation. The perfect example of this is in the simplified FX script component suite, where attributes, functions, and binding make it much easier to create a simpler API. I once tried to create ease-of-use Java wrappers around Swing (remember JDNC?) and the improvement was marginal at best.

What would you consider to be Swing’s weak points, and how are they addressed in JavaFX?

I see two primary issues in Swing which JavaFX seeks to resolve:

  1. If you code in Swing, you have to be somewhat of a plumber. I’d argue that Swing is necessarily complex, as are other toolkits in its class, which strive to solve the general case of UI construction. However, features in JavaFX script (again, declarative syntax, binding, functions) result in streamlining GUI assembly because you declare what you want and the plumbing is handled under the covers by the compiler. Anticipating the usual counter point, some will argue that you’re better off if you understand the plumbing, as you’ll be able to more easily debug problems. Well, I say that most developers don’t want to be plumbers; they just want it to work and provide sensible feedback when there’s a crack in the pipe.
  2. Swing components don’t live in the 2D coordinate space. I was a NeWS fan, so this has always bothered me. And although you can implement animated transitions and visual effects using clever imaging tricks, it requires a high level of expertise and it’s difficult to tool. The new SceneGraph API changes all that and is the underlying technology that enables the cool, animated GUIs you see in JavaFX. Swing components can be used as 2D nodes in a scene graph, allowing affine transforms and composite operations to be applied. Building on that is Chris Campbell’s Effects Framework, which encapsulates the most common visual effects (drop shadows, blurs, lighting, etc), which is my personal dream come true.

Anything else that you want to tell us about Swing, JavaFX or client technologies in general?

JavaOne tends to get caught up in whatever is new and sexy. Yet my favorite announcements (and the most under-sung, in my opinion) were around Java6 Update 10:

  • Java Kernel
  • Next Generation Java Plugin
  • Deployment Toolkit
  • Nimbus Look and Feel
  • Java Quick Starter
  • More graphics acceleration for Java2D
  • Shaped and translucent toplevel windows

See Java6 Update10 Overview for details.

After all, if we don’t resolve these issues, it really doesn’t matter what else we do.

Here are some Swing links that you might have missed during this week:

  • This subject seems to come up every now and then over the last couple of years. Supporting CSS in Swing has been mentioned in Ben Galbraith‘s presentation at last year’s JavaOne, Eitan Suez‘s JMatter has a CSS module in it, and the naming conventions for styles in Nimbus is very similar in concept to CSS. Now, there is a new project on SourceForge led by Angelo Zerr and Jawher Moussa that aims to provide a toolkit for declaratively building UIs. The Tk-UI project has, among the rest, an engine for applying CSS styles on Swing and SWT components.
  • Danno Ferrin has published the Groovy Twitter client from his JavaOne session. The entry has a link to the WebStart demo and the sources. The application itself uses the Nimbus look-and-feel if it is available.
  • A new section has been added to the release notes of the new plugin in JDK 6u10. It describes the functionality of dragging the applets to the desktop. Unlike the existing lifecycle methods defined in the Applet and JApplet methods, the relevant APIs are not APIs at all. So, pay very close attention to how you name your methods, because the compiler and the IDE won’t help you.
  • Dmitry Bondarenko has written an official guide to the translucent and shaped windows in 6u10.  Not much in the way of new information for those readers that saw my earlier introduction entry in February, the follow up on soft clipping and per-pixel translucency entry in March, and the java.net article on more advanced UI tricks. However, having the official Sun documentation gives a more prominent status to this functionality, raising the predictable question from Eric Burke – is it, or is it not a new official API?
  • Alex Ruiz points to the new NetBeans plugin written by Geertjan Wielenga. This plugin wraps the FEST-Swing UI testing framework and allows easy creation of UI tests from within NetBeans.
  • Christopher Deckers has announced the new release 0.9.5 of DJ Native Swing project that aims to provide integration of native components, such as web browser, Flash player, multimedia player and HTML editor into Swing applications.
  • Finally, Jonathan Schwartz lays out his plans for JavaFX. This is the first (at least in my memory) time that he is talking explicitly about Java on client.

Here are some Swing links that you might have missed during this week:

  • Christophe Le Besnerais has a custom implementation of Paint interface to paint a glossy button with arc-shaped gradient. Paint is one of the more advanced concepts in Java2D and it’s tricky to create a performant implementation. The only visual thing that is missing for here in the whole “web 2.0” concept is the soft-clipping along the arc itself (especially visible if you change the value of the third slider that controls the color of the top part. Chris Campbell has written about this problem before, and his solution involves an intermediate image.
  • Roman Kennke posts an update on progress of Caciocavallo project that aims to create an AWT implementation for X Window System without using any of Sun’s internal classes.
  • Jacek Furmankiewicz continues working on the SwingBuilder project, adding more support for bindings, long running tasks and integration with Commons Validation.
  • Hans Muller‘s swan song has been sent to the users mailing list of AppFramework (reference implementation of JSR 296). I have already mentioned that this project has been effectively dead for the last six months, and Hans has quite a long list of to-do things in his posting. This project has been heavily promoted throughout the entire desktop track at JavaOne this week, and even though Amy Fowler assures that it will continue to be developed, it would be wise to wait and see if the words are backed by @Actions :)
  • Geertjan Wielenga writes about using Maxim Zakharenkov‘s SwingExplorer inside a NetBeans module.

And some stray thoughts on JavaOne:

  • Underpromise and overdeliver. Good example – the playback video support for JavaFX and Java. Bad example – javafx.com.
  • I wonder why the video support hasn’t been featured more prominently during the keynote (instead of the frozen single-threaded demos). This is a very significant step forward for client Java, much more so than glitzier eye-candy dragging applets to the desktop. On the other hand, when the hype is that applets are back, who am i to judge?
  • I was almost hoping that the video support would address the number one wish i had for desktop Java in 2008 – cross-platform support for H.264 and FLV. We’re still not there yet – the cross-platform codecs are rather unknown in the general desktop area (one from On2, and another from the Open Media Commons project that has yet to deliver any binaries), and H.264 and FLV will only be supported when native codes are installed.
  • And no, those were not 200 different video streams mapped on the rotating cube. Those were 200 different views on a handful of different video streams. Still impressive.
  • The best presentation that i have attended did not use a single slide from Sun’s template. Those of you who are familiar with work of Garr Reynolds and Nancy Duarte should already know the answer to “why?”, and Ben Galbraith’s reputation has apparently allowed him to swerve past Sun’s lawyers and copywriters to present a very strong, clean and focused talk on user and interaction design.
  • And while we’re at it – do we really have to ruin every single session title and slide that use the word Java? I think we can figure out if Java is Java™ technology, Java™ platform or Java™ programming language by ourselves . At least they didn’t turn “Effective Java” into “Effective Java™ Programming Language”…
  • Literally bending and picking ugly things off the stage, having dozens of people come and go, showing IDE screens with 50+ lines of code, demoes freezing on the most important day of the year. Makes one wonder why Steve Jobs’ presentations get so much hyped before, during and after…